2023-07-24 00:05:59,694 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 00:05:59,993 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3 2023-07-24 00:05:59,993 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-24 00:06:00,047 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 00:06:00,355 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 00:06:00,356 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9, deleteOnExit=true 2023-07-24 00:06:00,356 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 00:06:00,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/test.cache.data in system properties and HBase conf 2023-07-24 00:06:00,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 00:06:00,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop.log.dir in system properties and HBase conf 2023-07-24 00:06:00,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 00:06:00,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 00:06:00,359 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 00:06:00,723 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 00:06:00,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 00:06:00,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 00:06:00,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 00:06:00,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 00:06:00,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 00:06:00,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 00:06:00,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 00:06:00,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 00:06:00,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 00:06:00,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/nfs.dump.dir in system properties and HBase conf 2023-07-24 00:06:00,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir in system properties and HBase conf 2023-07-24 00:06:00,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 00:06:00,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 00:06:00,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 00:06:01,380 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 00:06:01,387 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 00:06:01,749 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 00:06:01,950 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 00:06:01,971 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:02,026 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:02,068 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_localhost_35811_hdfs____2a9heo/webapp 2023-07-24 00:06:02,258 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35811 2023-07-24 00:06:02,275 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 00:06:02,275 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 00:06:02,864 WARN [Listener at localhost/46711] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 00:06:02,961 WARN [Listener at localhost/46711] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 00:06:03,031 WARN [Listener at localhost/46711] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:03,045 INFO [Listener at localhost/46711] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:03,068 INFO [Listener at localhost/46711] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_localhost_38433_datanode____.gp6m4q/webapp 2023-07-24 00:06:03,213 INFO [Listener at localhost/46711] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38433 2023-07-24 00:06:03,720 WARN [Listener at localhost/43769] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 00:06:03,756 WARN [Listener at localhost/43769] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 00:06:03,762 WARN [Listener at localhost/43769] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:03,764 INFO [Listener at localhost/43769] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:03,775 INFO [Listener at localhost/43769] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_localhost_34381_datanode____v2lcya/webapp 2023-07-24 00:06:03,915 INFO [Listener at localhost/43769] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34381 2023-07-24 00:06:03,938 WARN [Listener at localhost/43181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 00:06:03,976 WARN [Listener at localhost/43181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 00:06:03,984 WARN [Listener at localhost/43181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:03,986 INFO [Listener at localhost/43181] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:04,001 INFO [Listener at localhost/43181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_localhost_43645_datanode____8nz0ov/webapp 2023-07-24 00:06:04,163 INFO [Listener at localhost/43181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43645 2023-07-24 00:06:04,183 WARN [Listener at localhost/44909] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 00:06:04,569 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb6df3dc2d4ac369d: Processing first storage report for DS-fd8d048e-7f36-4da3-94f1-091d62c80697 from datanode b51d80d7-75f4-4669-8569-3c2ef4409c15 2023-07-24 00:06:04,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb6df3dc2d4ac369d: from storage DS-fd8d048e-7f36-4da3-94f1-091d62c80697 node DatanodeRegistration(127.0.0.1:33519, datanodeUuid=b51d80d7-75f4-4669-8569-3c2ef4409c15, infoPort=43053, infoSecurePort=0, ipcPort=44909, storageInfo=lv=-57;cid=testClusterID;nsid=669884423;c=1690157161479), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 00:06:04,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb39c322a6a314df: Processing first storage report for DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a from datanode d12f50a7-c1e7-42bf-bfec-2ec6af50f38e 2023-07-24 00:06:04,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb39c322a6a314df: from storage DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a node DatanodeRegistration(127.0.0.1:33739, datanodeUuid=d12f50a7-c1e7-42bf-bfec-2ec6af50f38e, infoPort=36251, infoSecurePort=0, ipcPort=43769, storageInfo=lv=-57;cid=testClusterID;nsid=669884423;c=1690157161479), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 00:06:04,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3fd1fa041c0da72c: Processing first storage report for DS-95f940f3-d30b-402c-b59d-6cd9902db722 from datanode b79e79fc-746f-4430-9060-01505470011b 2023-07-24 00:06:04,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3fd1fa041c0da72c: from storage DS-95f940f3-d30b-402c-b59d-6cd9902db722 node DatanodeRegistration(127.0.0.1:34721, datanodeUuid=b79e79fc-746f-4430-9060-01505470011b, infoPort=37395, infoSecurePort=0, ipcPort=43181, storageInfo=lv=-57;cid=testClusterID;nsid=669884423;c=1690157161479), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 00:06:04,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb6df3dc2d4ac369d: Processing first storage report for DS-324bce65-dd19-4963-bab5-32e5ec42dc31 from datanode b51d80d7-75f4-4669-8569-3c2ef4409c15 2023-07-24 00:06:04,572 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb6df3dc2d4ac369d: from storage DS-324bce65-dd19-4963-bab5-32e5ec42dc31 node DatanodeRegistration(127.0.0.1:33519, datanodeUuid=b51d80d7-75f4-4669-8569-3c2ef4409c15, infoPort=43053, infoSecurePort=0, ipcPort=44909, storageInfo=lv=-57;cid=testClusterID;nsid=669884423;c=1690157161479), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 00:06:04,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb39c322a6a314df: Processing first storage report for DS-bb424439-858a-437d-beb9-71821d4d8068 from datanode d12f50a7-c1e7-42bf-bfec-2ec6af50f38e 2023-07-24 00:06:04,572 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb39c322a6a314df: from storage DS-bb424439-858a-437d-beb9-71821d4d8068 node DatanodeRegistration(127.0.0.1:33739, datanodeUuid=d12f50a7-c1e7-42bf-bfec-2ec6af50f38e, infoPort=36251, infoSecurePort=0, ipcPort=43769, storageInfo=lv=-57;cid=testClusterID;nsid=669884423;c=1690157161479), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 00:06:04,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3fd1fa041c0da72c: Processing first storage report for DS-2c15bf49-eebe-47e8-8f3c-643f1c6a4ae6 from datanode b79e79fc-746f-4430-9060-01505470011b 2023-07-24 00:06:04,572 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3fd1fa041c0da72c: from storage DS-2c15bf49-eebe-47e8-8f3c-643f1c6a4ae6 node DatanodeRegistration(127.0.0.1:34721, datanodeUuid=b79e79fc-746f-4430-9060-01505470011b, infoPort=37395, infoSecurePort=0, ipcPort=43181, storageInfo=lv=-57;cid=testClusterID;nsid=669884423;c=1690157161479), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 00:06:04,798 DEBUG [Listener at localhost/44909] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3 2023-07-24 00:06:04,907 INFO [Listener at localhost/44909] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/zookeeper_0, clientPort=56229, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 00:06:04,933 INFO [Listener at localhost/44909] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56229 2023-07-24 00:06:04,944 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:04,947 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:05,705 INFO [Listener at localhost/44909] util.FSUtils(471): Created version file at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b with version=8 2023-07-24 00:06:05,705 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/hbase-staging 2023-07-24 00:06:06,149 INFO [Listener at localhost/44909] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 00:06:06,823 INFO [Listener at localhost/44909] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 00:06:06,863 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:06,864 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:06,864 INFO [Listener at localhost/44909] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 00:06:06,864 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:06,864 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 00:06:07,024 INFO [Listener at localhost/44909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 00:06:07,105 DEBUG [Listener at localhost/44909] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 00:06:07,217 INFO [Listener at localhost/44909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46285 2023-07-24 00:06:07,230 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,232 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,260 INFO [Listener at localhost/44909] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46285 connecting to ZooKeeper ensemble=127.0.0.1:56229 2023-07-24 00:06:07,330 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:462850x0, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 00:06:07,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46285-0x10194a62c510000 connected 2023-07-24 00:06:07,393 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 00:06:07,394 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:06:07,414 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 00:06:07,426 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46285 2023-07-24 00:06:07,428 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46285 2023-07-24 00:06:07,429 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46285 2023-07-24 00:06:07,439 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46285 2023-07-24 00:06:07,444 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46285 2023-07-24 00:06:07,454 INFO [Listener at localhost/44909] master.HMaster(444): hbase.rootdir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, hbase.cluster.distributed=false 2023-07-24 00:06:07,576 INFO [Listener at localhost/44909] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 00:06:07,577 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,577 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,577 INFO [Listener at localhost/44909] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 00:06:07,577 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,577 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 00:06:07,582 INFO [Listener at localhost/44909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 00:06:07,586 INFO [Listener at localhost/44909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34461 2023-07-24 00:06:07,589 INFO [Listener at localhost/44909] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 00:06:07,597 DEBUG [Listener at localhost/44909] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 00:06:07,598 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,601 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,603 INFO [Listener at localhost/44909] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34461 connecting to ZooKeeper ensemble=127.0.0.1:56229 2023-07-24 00:06:07,609 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:344610x0, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 00:06:07,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34461-0x10194a62c510001 connected 2023-07-24 00:06:07,611 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 00:06:07,612 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:06:07,613 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 00:06:07,618 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34461 2023-07-24 00:06:07,618 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34461 2023-07-24 00:06:07,619 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34461 2023-07-24 00:06:07,622 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34461 2023-07-24 00:06:07,623 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34461 2023-07-24 00:06:07,637 INFO [Listener at localhost/44909] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 00:06:07,637 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,637 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,638 INFO [Listener at localhost/44909] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 00:06:07,639 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,639 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 00:06:07,639 INFO [Listener at localhost/44909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 00:06:07,641 INFO [Listener at localhost/44909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32955 2023-07-24 00:06:07,642 INFO [Listener at localhost/44909] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 00:06:07,643 DEBUG [Listener at localhost/44909] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 00:06:07,644 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,647 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,653 INFO [Listener at localhost/44909] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32955 connecting to ZooKeeper ensemble=127.0.0.1:56229 2023-07-24 00:06:07,665 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:329550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 00:06:07,666 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:329550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 00:06:07,667 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:329550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:06:07,668 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:329550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 00:06:07,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32955-0x10194a62c510002 connected 2023-07-24 00:06:07,674 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32955 2023-07-24 00:06:07,675 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32955 2023-07-24 00:06:07,675 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32955 2023-07-24 00:06:07,676 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32955 2023-07-24 00:06:07,676 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32955 2023-07-24 00:06:07,694 INFO [Listener at localhost/44909] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 00:06:07,694 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,695 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,695 INFO [Listener at localhost/44909] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 00:06:07,695 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 00:06:07,695 INFO [Listener at localhost/44909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 00:06:07,695 INFO [Listener at localhost/44909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 00:06:07,699 INFO [Listener at localhost/44909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41155 2023-07-24 00:06:07,699 INFO [Listener at localhost/44909] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 00:06:07,701 DEBUG [Listener at localhost/44909] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 00:06:07,702 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,704 INFO [Listener at localhost/44909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,706 INFO [Listener at localhost/44909] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41155 connecting to ZooKeeper ensemble=127.0.0.1:56229 2023-07-24 00:06:07,711 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:411550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 00:06:07,712 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:411550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 00:06:07,713 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:411550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:06:07,714 DEBUG [Listener at localhost/44909] zookeeper.ZKUtil(164): regionserver:411550x0, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 00:06:07,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41155-0x10194a62c510003 connected 2023-07-24 00:06:07,715 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41155 2023-07-24 00:06:07,715 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41155 2023-07-24 00:06:07,718 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41155 2023-07-24 00:06:07,719 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41155 2023-07-24 00:06:07,720 DEBUG [Listener at localhost/44909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41155 2023-07-24 00:06:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:07,741 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 00:06:07,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:07,769 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 00:06:07,769 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 00:06:07,769 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 00:06:07,769 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 00:06:07,769 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:07,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 00:06:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46285,1690157165912 from backup master directory 2023-07-24 00:06:07,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 00:06:07,779 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:07,780 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 00:06:07,780 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 00:06:07,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:07,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 00:06:07,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 00:06:07,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/hbase.id with ID: d5b969b4-6655-4c31-9db2-22a8d0742cf3 2023-07-24 00:06:07,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 00:06:07,976 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:08,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4421d33a to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:08,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8714774, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:08,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:08,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 00:06:08,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 00:06:08,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 00:06:08,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 00:06:08,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 00:06:08,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 00:06:08,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store-tmp 2023-07-24 00:06:08,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:08,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 00:06:08,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:06:08,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:06:08,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 00:06:08,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:06:08,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:06:08,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 00:06:08,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/WALs/jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:08,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46285%2C1690157165912, suffix=, logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/WALs/jenkins-hbase4.apache.org,46285,1690157165912, archiveDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/oldWALs, maxLogs=10 2023-07-24 00:06:08,438 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK] 2023-07-24 00:06:08,438 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK] 2023-07-24 00:06:08,450 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK] 2023-07-24 00:06:08,451 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 00:06:08,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/WALs/jenkins-hbase4.apache.org,46285,1690157165912/jenkins-hbase4.apache.org%2C46285%2C1690157165912.1690157168335 2023-07-24 00:06:08,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK], DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK], DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK]] 2023-07-24 00:06:08,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 00:06:08,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:08,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 00:06:08,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 00:06:08,655 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 00:06:08,665 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 00:06:08,700 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 00:06:08,714 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:08,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 00:06:08,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 00:06:08,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 00:06:08,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:08,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70177800, jitterRate=0.04573071002960205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:08,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 00:06:08,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 00:06:08,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 00:06:08,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 00:06:08,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 00:06:08,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 00:06:08,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-24 00:06:08,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 00:06:08,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 00:06:08,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 00:06:08,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 00:06:08,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 00:06:08,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 00:06:08,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 00:06:08,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 00:06:08,934 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:08,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 00:06:08,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 00:06:08,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 00:06:08,962 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 00:06:08,962 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 00:06:08,962 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 00:06:08,962 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 00:06:08,962 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:08,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46285,1690157165912, sessionid=0x10194a62c510000, setting cluster-up flag (Was=false) 2023-07-24 00:06:08,983 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:08,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 00:06:08,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:08,999 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:09,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 00:06:09,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:09,010 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp 2023-07-24 00:06:09,038 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(951): ClusterId : d5b969b4-6655-4c31-9db2-22a8d0742cf3 2023-07-24 00:06:09,038 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(951): ClusterId : d5b969b4-6655-4c31-9db2-22a8d0742cf3 2023-07-24 00:06:09,044 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(951): ClusterId : d5b969b4-6655-4c31-9db2-22a8d0742cf3 2023-07-24 00:06:09,048 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 00:06:09,048 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 00:06:09,048 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 00:06:09,070 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 00:06:09,070 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 00:06:09,070 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 00:06:09,071 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 00:06:09,073 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 00:06:09,073 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 00:06:09,074 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 00:06:09,076 DEBUG [RS:0;jenkins-hbase4:34461] zookeeper.ReadOnlyZKClient(139): Connect 0x45cf7bd4 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:09,077 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 00:06:09,080 DEBUG [RS:2;jenkins-hbase4:41155] zookeeper.ReadOnlyZKClient(139): Connect 0x7c83ded0 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:09,080 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 00:06:09,093 DEBUG [RS:1;jenkins-hbase4:32955] zookeeper.ReadOnlyZKClient(139): Connect 0x4f7498bc to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:09,107 DEBUG [RS:2;jenkins-hbase4:41155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72442f30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:09,107 DEBUG [RS:0;jenkins-hbase4:34461] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b089d1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:09,108 DEBUG [RS:2;jenkins-hbase4:41155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@767bb5a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 00:06:09,108 DEBUG [RS:0;jenkins-hbase4:34461] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3710a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 00:06:09,147 DEBUG [RS:1;jenkins-hbase4:32955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41b37f22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:09,148 DEBUG [RS:1;jenkins-hbase4:32955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@458cf3cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 00:06:09,179 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:32955 2023-07-24 00:06:09,180 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34461 2023-07-24 00:06:09,186 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41155 2023-07-24 00:06:09,190 INFO [RS:1;jenkins-hbase4:32955] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 00:06:09,195 INFO [RS:1;jenkins-hbase4:32955] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 00:06:09,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 00:06:09,190 INFO [RS:2;jenkins-hbase4:41155] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 00:06:09,196 INFO [RS:2;jenkins-hbase4:41155] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 00:06:09,190 INFO [RS:0;jenkins-hbase4:34461] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 00:06:09,197 INFO [RS:0;jenkins-hbase4:34461] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 00:06:09,200 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 00:06:09,200 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 00:06:09,200 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 00:06:09,202 INFO [RS:2;jenkins-hbase4:41155] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:09,202 INFO [RS:1;jenkins-hbase4:32955] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:09,202 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 00:06:09,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:09,202 INFO [RS:0;jenkins-hbase4:34461] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:09,203 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 00:06:09,202 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 00:06:09,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 00:06:09,207 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46285,1690157165912 with isa=jenkins-hbase4.apache.org/172.31.14.131:34461, startcode=1690157167575 2023-07-24 00:06:09,207 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46285,1690157165912 with isa=jenkins-hbase4.apache.org/172.31.14.131:32955, startcode=1690157167636 2023-07-24 00:06:09,207 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46285,1690157165912 with isa=jenkins-hbase4.apache.org/172.31.14.131:41155, startcode=1690157167693 2023-07-24 00:06:09,227 DEBUG [RS:0;jenkins-hbase4:34461] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 00:06:09,227 DEBUG [RS:2;jenkins-hbase4:41155] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 00:06:09,227 DEBUG [RS:1;jenkins-hbase4:32955] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 00:06:09,309 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49659, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 00:06:09,309 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46581, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 00:06:09,309 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39083, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 00:06:09,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 00:06:09,318 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46285] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 00:06:09,331 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46285] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 00:06:09,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,343 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46285] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 00:06:09,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690157199352 2023-07-24 00:06:09,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 00:06:09,358 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 00:06:09,359 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 00:06:09,364 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:09,365 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 00:06:09,366 WARN [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 00:06:09,366 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 00:06:09,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 00:06:09,366 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 00:06:09,371 WARN [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 00:06:09,371 WARN [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 00:06:09,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 00:06:09,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 00:06:09,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 00:06:09,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 00:06:09,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 00:06:09,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 00:06:09,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 00:06:09,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 00:06:09,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 00:06:09,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690157169399,5,FailOnTimeoutGroup] 2023-07-24 00:06:09,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690157169399,5,FailOnTimeoutGroup] 2023-07-24 00:06:09,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 00:06:09,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,426 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:09,427 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:09,427 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:09,457 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:09,461 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 00:06:09,466 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/info 2023-07-24 00:06:09,467 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46285,1690157165912 with isa=jenkins-hbase4.apache.org/172.31.14.131:32955, startcode=1690157167636 2023-07-24 00:06:09,467 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 00:06:09,469 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:09,469 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 00:06:09,478 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46285,1690157165912 with isa=jenkins-hbase4.apache.org/172.31.14.131:41155, startcode=1690157167693 2023-07-24 00:06:09,481 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46285] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,481 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/rep_barrier 2023-07-24 00:06:09,481 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46285,1690157165912 with isa=jenkins-hbase4.apache.org/172.31.14.131:34461, startcode=1690157167575 2023-07-24 00:06:09,482 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 00:06:09,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:09,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 00:06:09,488 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/table 2023-07-24 00:06:09,489 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 00:06:09,490 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46285] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,491 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:09,492 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46711 2023-07-24 00:06:09,492 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 00:06:09,492 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46285] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:09,493 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:09,494 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46711 2023-07-24 00:06:09,494 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 00:06:09,495 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:09,495 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46711 2023-07-24 00:06:09,495 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 00:06:09,498 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740 2023-07-24 00:06:09,499 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740 2023-07-24 00:06:09,505 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 00:06:09,509 DEBUG [RS:0;jenkins-hbase4:34461] zookeeper.ZKUtil(162): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,509 WARN [RS:0;jenkins-hbase4:34461] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 00:06:09,509 INFO [RS:0;jenkins-hbase4:34461] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 00:06:09,509 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,514 DEBUG [RS:2;jenkins-hbase4:41155] zookeeper.ZKUtil(162): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,514 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:06:09,514 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 00:06:09,514 WARN [RS:2;jenkins-hbase4:41155] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 00:06:09,516 INFO [RS:2;jenkins-hbase4:41155] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 00:06:09,519 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,520 DEBUG [RS:1;jenkins-hbase4:32955] zookeeper.ZKUtil(162): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,520 WARN [RS:1;jenkins-hbase4:32955] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 00:06:09,520 INFO [RS:1;jenkins-hbase4:32955] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 00:06:09,520 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,536 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34461,1690157167575] 2023-07-24 00:06:09,536 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41155,1690157167693] 2023-07-24 00:06:09,536 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32955,1690157167636] 2023-07-24 00:06:09,538 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:09,541 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61396253, jitterRate=-0.08512453734874725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 00:06:09,541 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 00:06:09,542 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 00:06:09,542 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 00:06:09,542 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 00:06:09,542 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 00:06:09,542 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 00:06:09,543 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 00:06:09,543 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 00:06:09,546 DEBUG [RS:2;jenkins-hbase4:41155] zookeeper.ZKUtil(162): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,546 DEBUG [RS:0;jenkins-hbase4:34461] zookeeper.ZKUtil(162): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,548 DEBUG [RS:0;jenkins-hbase4:34461] zookeeper.ZKUtil(162): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,548 DEBUG [RS:2;jenkins-hbase4:41155] zookeeper.ZKUtil(162): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,548 DEBUG [RS:2;jenkins-hbase4:41155] zookeeper.ZKUtil(162): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,550 DEBUG [RS:0;jenkins-hbase4:34461] zookeeper.ZKUtil(162): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,551 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 00:06:09,551 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 00:06:09,557 DEBUG [RS:1;jenkins-hbase4:32955] zookeeper.ZKUtil(162): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,557 DEBUG [RS:1;jenkins-hbase4:32955] zookeeper.ZKUtil(162): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,558 DEBUG [RS:1;jenkins-hbase4:32955] zookeeper.ZKUtil(162): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,567 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 00:06:09,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 00:06:09,574 DEBUG [RS:0;jenkins-hbase4:34461] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 00:06:09,574 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 00:06:09,578 INFO [RS:0;jenkins-hbase4:34461] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 00:06:09,578 INFO [RS:2;jenkins-hbase4:41155] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 00:06:09,578 INFO [RS:1;jenkins-hbase4:32955] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 00:06:09,586 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 00:06:09,590 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 00:06:09,604 INFO [RS:1;jenkins-hbase4:32955] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 00:06:09,607 INFO [RS:0;jenkins-hbase4:34461] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 00:06:09,607 INFO [RS:2;jenkins-hbase4:41155] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 00:06:09,617 INFO [RS:0;jenkins-hbase4:34461] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 00:06:09,617 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,623 INFO [RS:1;jenkins-hbase4:32955] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 00:06:09,624 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,631 INFO [RS:2;jenkins-hbase4:41155] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 00:06:09,631 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,633 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 00:06:09,633 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 00:06:09,633 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 00:06:09,644 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,644 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,644 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,645 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,645 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 00:06:09,646 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 00:06:09,646 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,647 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,648 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,648 DEBUG [RS:2;jenkins-hbase4:41155] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,648 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,648 DEBUG [RS:1;jenkins-hbase4:32955] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,646 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,651 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,651 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,651 DEBUG [RS:0;jenkins-hbase4:34461] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 00:06:09,656 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,657 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,657 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,670 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,671 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,671 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,679 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,679 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,679 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,687 INFO [RS:2;jenkins-hbase4:41155] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 00:06:09,688 INFO [RS:0;jenkins-hbase4:34461] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 00:06:09,691 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34461,1690157167575-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,692 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41155,1690157167693-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,697 INFO [RS:1;jenkins-hbase4:32955] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 00:06:09,697 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32955,1690157167636-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:09,730 INFO [RS:0;jenkins-hbase4:34461] regionserver.Replication(203): jenkins-hbase4.apache.org,34461,1690157167575 started 2023-07-24 00:06:09,731 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34461,1690157167575, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34461, sessionid=0x10194a62c510001 2023-07-24 00:06:09,732 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 00:06:09,732 DEBUG [RS:0;jenkins-hbase4:34461] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,733 DEBUG [RS:0;jenkins-hbase4:34461] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34461,1690157167575' 2023-07-24 00:06:09,733 DEBUG [RS:0;jenkins-hbase4:34461] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 00:06:09,733 INFO [RS:2;jenkins-hbase4:41155] regionserver.Replication(203): jenkins-hbase4.apache.org,41155,1690157167693 started 2023-07-24 00:06:09,733 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41155,1690157167693, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41155, sessionid=0x10194a62c510003 2023-07-24 00:06:09,733 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 00:06:09,733 DEBUG [RS:2;jenkins-hbase4:41155] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,734 DEBUG [RS:2;jenkins-hbase4:41155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41155,1690157167693' 2023-07-24 00:06:09,739 DEBUG [RS:2;jenkins-hbase4:41155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 00:06:09,742 DEBUG [jenkins-hbase4:46285] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 00:06:09,743 DEBUG [RS:0;jenkins-hbase4:34461] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 00:06:09,743 DEBUG [RS:2;jenkins-hbase4:41155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 00:06:09,744 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 00:06:09,744 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 00:06:09,744 DEBUG [RS:0;jenkins-hbase4:34461] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:09,744 DEBUG [RS:0;jenkins-hbase4:34461] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34461,1690157167575' 2023-07-24 00:06:09,745 DEBUG [RS:0;jenkins-hbase4:34461] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:09,745 DEBUG [RS:0;jenkins-hbase4:34461] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:09,746 DEBUG [RS:0;jenkins-hbase4:34461] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 00:06:09,746 INFO [RS:0;jenkins-hbase4:34461] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 00:06:09,746 INFO [RS:0;jenkins-hbase4:34461] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 00:06:09,748 DEBUG [jenkins-hbase4:46285] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:06:09,748 INFO [RS:1;jenkins-hbase4:32955] regionserver.Replication(203): jenkins-hbase4.apache.org,32955,1690157167636 started 2023-07-24 00:06:09,748 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32955,1690157167636, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32955, sessionid=0x10194a62c510002 2023-07-24 00:06:09,748 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 00:06:09,750 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 00:06:09,751 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 00:06:09,751 DEBUG [RS:1;jenkins-hbase4:32955] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,759 DEBUG [RS:1;jenkins-hbase4:32955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32955,1690157167636' 2023-07-24 00:06:09,751 DEBUG [RS:2;jenkins-hbase4:41155] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:09,759 DEBUG [RS:1;jenkins-hbase4:32955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 00:06:09,759 DEBUG [RS:2;jenkins-hbase4:41155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41155,1690157167693' 2023-07-24 00:06:09,759 DEBUG [RS:2;jenkins-hbase4:41155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:09,760 DEBUG [RS:1;jenkins-hbase4:32955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 00:06:09,760 DEBUG [RS:2;jenkins-hbase4:41155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:09,760 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 00:06:09,760 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 00:06:09,760 DEBUG [RS:1;jenkins-hbase4:32955] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:09,761 DEBUG [RS:1;jenkins-hbase4:32955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32955,1690157167636' 2023-07-24 00:06:09,761 DEBUG [RS:1;jenkins-hbase4:32955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:09,761 DEBUG [RS:2;jenkins-hbase4:41155] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 00:06:09,761 INFO [RS:2;jenkins-hbase4:41155] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 00:06:09,762 INFO [RS:2;jenkins-hbase4:41155] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 00:06:09,765 DEBUG [jenkins-hbase4:46285] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:06:09,765 DEBUG [jenkins-hbase4:46285] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:06:09,765 DEBUG [jenkins-hbase4:46285] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:06:09,766 DEBUG [RS:1;jenkins-hbase4:32955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:09,766 DEBUG [jenkins-hbase4:46285] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:06:09,766 DEBUG [RS:1;jenkins-hbase4:32955] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 00:06:09,766 INFO [RS:1;jenkins-hbase4:32955] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 00:06:09,766 INFO [RS:1;jenkins-hbase4:32955] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 00:06:09,770 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41155,1690157167693, state=OPENING 2023-07-24 00:06:09,778 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 00:06:09,779 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:09,780 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 00:06:09,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41155,1690157167693}] 2023-07-24 00:06:09,857 INFO [RS:0;jenkins-hbase4:34461] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34461%2C1690157167575, suffix=, logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,34461,1690157167575, archiveDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs, maxLogs=32 2023-07-24 00:06:09,870 INFO [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41155%2C1690157167693, suffix=, logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,41155,1690157167693, archiveDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs, maxLogs=32 2023-07-24 00:06:09,871 INFO [RS:1;jenkins-hbase4:32955] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32955%2C1690157167636, suffix=, logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,32955,1690157167636, archiveDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs, maxLogs=32 2023-07-24 00:06:09,903 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK] 2023-07-24 00:06:09,908 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK] 2023-07-24 00:06:09,911 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK] 2023-07-24 00:06:09,979 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK] 2023-07-24 00:06:09,979 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK] 2023-07-24 00:06:09,982 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK] 2023-07-24 00:06:09,983 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK] 2023-07-24 00:06:09,983 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK] 2023-07-24 00:06:09,982 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK] 2023-07-24 00:06:09,992 INFO [RS:0;jenkins-hbase4:34461] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,34461,1690157167575/jenkins-hbase4.apache.org%2C34461%2C1690157167575.1690157169860 2023-07-24 00:06:10,004 DEBUG [RS:0;jenkins-hbase4:34461] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK], DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK], DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK]] 2023-07-24 00:06:10,011 INFO [RS:1;jenkins-hbase4:32955] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,32955,1690157167636/jenkins-hbase4.apache.org%2C32955%2C1690157167636.1690157169874 2023-07-24 00:06:10,012 DEBUG [RS:1;jenkins-hbase4:32955] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK], DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK], DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK]] 2023-07-24 00:06:10,027 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:10,031 INFO [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,41155,1690157167693/jenkins-hbase4.apache.org%2C41155%2C1690157167693.1690157169872 2023-07-24 00:06:10,031 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 00:06:10,039 DEBUG [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK], DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK], DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK]] 2023-07-24 00:06:10,048 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 00:06:10,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 00:06:10,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 00:06:10,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41155%2C1690157167693.meta, suffix=.meta, logDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,41155,1690157167693, archiveDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs, maxLogs=32 2023-07-24 00:06:10,103 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK] 2023-07-24 00:06:10,120 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK] 2023-07-24 00:06:10,120 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK] 2023-07-24 00:06:10,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/WALs/jenkins-hbase4.apache.org,41155,1690157167693/jenkins-hbase4.apache.org%2C41155%2C1690157167693.meta.1690157170076.meta 2023-07-24 00:06:10,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33739,DS-7ec42dd2-6d7f-42f0-a19c-00fe7ab5584a,DISK], DatanodeInfoWithStorage[127.0.0.1:33519,DS-fd8d048e-7f36-4da3-94f1-091d62c80697,DISK], DatanodeInfoWithStorage[127.0.0.1:34721,DS-95f940f3-d30b-402c-b59d-6cd9902db722,DISK]] 2023-07-24 00:06:10,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 00:06:10,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 00:06:10,147 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:10,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 00:06:10,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 00:06:10,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 00:06:10,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 00:06:10,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:10,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 00:06:10,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 00:06:10,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 00:06:10,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/info 2023-07-24 00:06:10,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/info 2023-07-24 00:06:10,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 00:06:10,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:10,194 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 00:06:10,196 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/rep_barrier 2023-07-24 00:06:10,196 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/rep_barrier 2023-07-24 00:06:10,199 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 00:06:10,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:10,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 00:06:10,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/table 2023-07-24 00:06:10,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/table 2023-07-24 00:06:10,203 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 00:06:10,205 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:10,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740 2023-07-24 00:06:10,212 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740 2023-07-24 00:06:10,218 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 00:06:10,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 00:06:10,228 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60715190, jitterRate=-0.09527316689491272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 00:06:10,232 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 00:06:10,252 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690157170015 2023-07-24 00:06:10,282 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 00:06:10,286 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 00:06:10,286 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41155,1690157167693, state=OPEN 2023-07-24 00:06:10,290 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 00:06:10,290 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 00:06:10,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 00:06:10,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41155,1690157167693 in 505 msec 2023-07-24 00:06:10,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 00:06:10,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 732 msec 2023-07-24 00:06:10,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0970 sec 2023-07-24 00:06:10,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690157170315, completionTime=-1 2023-07-24 00:06:10,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 00:06:10,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 00:06:10,425 DEBUG [hconnection-0x6da11b8b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:10,429 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:10,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 00:06:10,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690157230458 2023-07-24 00:06:10,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690157290458 2023-07-24 00:06:10,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 143 msec 2023-07-24 00:06:10,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46285,1690157165912-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:10,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46285,1690157165912-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:10,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46285,1690157165912-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:10,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46285, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:10,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 00:06:10,507 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 00:06:10,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 00:06:10,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:10,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 00:06:10,536 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:06:10,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:06:10,571 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:10,575 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda empty. 2023-07-24 00:06:10,576 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:10,576 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 00:06:10,625 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:10,631 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d011f7cc508caea71a587fe5802cfdda, NAME => 'hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:10,664 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:10,665 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d011f7cc508caea71a587fe5802cfdda, disabling compactions & flushes 2023-07-24 00:06:10,665 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:10,665 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:10,665 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. after waiting 0 ms 2023-07-24 00:06:10,665 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:10,665 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:10,665 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d011f7cc508caea71a587fe5802cfdda: 2023-07-24 00:06:10,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:06:10,690 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690157170675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157170675"}]},"ts":"1690157170675"} 2023-07-24 00:06:10,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 00:06:10,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:06:10,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157170730"}]},"ts":"1690157170730"} 2023-07-24 00:06:10,741 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 00:06:10,746 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:06:10,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:06:10,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:06:10,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:06:10,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:06:10,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d011f7cc508caea71a587fe5802cfdda, ASSIGN}] 2023-07-24 00:06:10,753 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d011f7cc508caea71a587fe5802cfdda, ASSIGN 2023-07-24 00:06:10,754 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d011f7cc508caea71a587fe5802cfdda, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:06:10,907 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 00:06:10,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d011f7cc508caea71a587fe5802cfdda, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:10,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690157170908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157170908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157170908"}]},"ts":"1690157170908"} 2023-07-24 00:06:10,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d011f7cc508caea71a587fe5802cfdda, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:06:11,069 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:11,069 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 00:06:11,072 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 00:06:11,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:11,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d011f7cc508caea71a587fe5802cfdda, NAME => 'hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.', STARTKEY => '', ENDKEY => ''} 2023-07-24 00:06:11,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. service=AccessControlService 2023-07-24 00:06:11,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:11,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:11,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,086 INFO [StoreOpener-d011f7cc508caea71a587fe5802cfdda-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,089 DEBUG [StoreOpener-d011f7cc508caea71a587fe5802cfdda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/info 2023-07-24 00:06:11,089 DEBUG [StoreOpener-d011f7cc508caea71a587fe5802cfdda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/info 2023-07-24 00:06:11,090 INFO [StoreOpener-d011f7cc508caea71a587fe5802cfdda-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d011f7cc508caea71a587fe5802cfdda columnFamilyName info 2023-07-24 00:06:11,091 INFO [StoreOpener-d011f7cc508caea71a587fe5802cfdda-1] regionserver.HStore(310): Store=d011f7cc508caea71a587fe5802cfdda/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:11,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,099 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:06:11,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:11,109 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d011f7cc508caea71a587fe5802cfdda; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63479536, jitterRate=-0.05408120155334473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:11,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d011f7cc508caea71a587fe5802cfdda: 2023-07-24 00:06:11,112 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda., pid=6, masterSystemTime=1690157171068 2023-07-24 00:06:11,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:11,119 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:06:11,121 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d011f7cc508caea71a587fe5802cfdda, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:11,121 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690157171120"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157171120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157171120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157171120"}]},"ts":"1690157171120"} 2023-07-24 00:06:11,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 00:06:11,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d011f7cc508caea71a587fe5802cfdda, server=jenkins-hbase4.apache.org,32955,1690157167636 in 211 msec 2023-07-24 00:06:11,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 00:06:11,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d011f7cc508caea71a587fe5802cfdda, ASSIGN in 382 msec 2023-07-24 00:06:11,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:06:11,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157171137"}]},"ts":"1690157171137"} 2023-07-24 00:06:11,140 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 00:06:11,145 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:06:11,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 623 msec 2023-07-24 00:06:11,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 00:06:11,237 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 00:06:11,237 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:11,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:11,262 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:11,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 00:06:11,293 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 00:06:11,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-24 00:06:11,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 00:06:11,322 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 00:06:11,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-24 00:06:11,335 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 00:06:11,339 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 00:06:11,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.558sec 2023-07-24 00:06:11,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 00:06:11,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 00:06:11,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 00:06:11,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46285,1690157165912-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 00:06:11,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46285,1690157165912-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 00:06:11,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:11,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 00:06:11,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:06:11,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:06:11,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 00:06:11,383 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/acl/6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,384 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/acl/6d53b70fd383073a4b2f482854421af3 empty. 2023-07-24 00:06:11,390 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/acl/6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,390 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 00:06:11,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 00:06:11,413 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:11,415 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d53b70fd383073a4b2f482854421af3, NAME => 'hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:11,445 DEBUG [Listener at localhost/44909] zookeeper.ReadOnlyZKClient(139): Connect 0x3c45df17 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:11,448 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:11,449 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6d53b70fd383073a4b2f482854421af3, disabling compactions & flushes 2023-07-24 00:06:11,449 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,449 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,449 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. after waiting 0 ms 2023-07-24 00:06:11,449 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,449 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,449 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6d53b70fd383073a4b2f482854421af3: 2023-07-24 00:06:11,453 DEBUG [Listener at localhost/44909] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25818eae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:11,460 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:06:11,462 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690157171462"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157171462"}]},"ts":"1690157171462"} 2023-07-24 00:06:11,465 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 00:06:11,467 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:06:11,467 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157171467"}]},"ts":"1690157171467"} 2023-07-24 00:06:11,471 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 00:06:11,472 DEBUG [hconnection-0x4056dd59-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:11,477 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:06:11,478 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:06:11,478 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:06:11,478 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:06:11,478 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:06:11,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d53b70fd383073a4b2f482854421af3, ASSIGN}] 2023-07-24 00:06:11,487 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:11,488 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d53b70fd383073a4b2f482854421af3, ASSIGN 2023-07-24 00:06:11,490 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6d53b70fd383073a4b2f482854421af3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41155,1690157167693; forceNewPlan=false, retain=false 2023-07-24 00:06:11,491 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:06:11,491 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 00:06:11,491 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/test.cache.data in system properties and HBase conf 2023-07-24 00:06:11,491 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 00:06:11,491 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop.log.dir in system properties and HBase conf 2023-07-24 00:06:11,492 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 00:06:11,492 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 00:06:11,492 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 00:06:11,492 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 00:06:11,492 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 00:06:11,492 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 00:06:11,493 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/nfs.dump.dir in system properties and HBase conf 2023-07-24 00:06:11,494 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir in system properties and HBase conf 2023-07-24 00:06:11,494 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 00:06:11,494 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 00:06:11,494 INFO [Listener at localhost/44909] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 00:06:11,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 00:06:11,641 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 00:06:11,642 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d53b70fd383073a4b2f482854421af3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:11,642 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690157171642"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157171642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157171642"}]},"ts":"1690157171642"} 2023-07-24 00:06:11,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6d53b70fd383073a4b2f482854421af3, server=jenkins-hbase4.apache.org,41155,1690157167693}] 2023-07-24 00:06:11,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 00:06:11,816 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d53b70fd383073a4b2f482854421af3, NAME => 'hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.', STARTKEY => '', ENDKEY => ''} 2023-07-24 00:06:11,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. service=AccessControlService 2023-07-24 00:06:11,817 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:11,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:11,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,822 INFO [StoreOpener-6d53b70fd383073a4b2f482854421af3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,833 DEBUG [StoreOpener-6d53b70fd383073a4b2f482854421af3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/l 2023-07-24 00:06:11,833 DEBUG [StoreOpener-6d53b70fd383073a4b2f482854421af3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/l 2023-07-24 00:06:11,834 INFO [StoreOpener-6d53b70fd383073a4b2f482854421af3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d53b70fd383073a4b2f482854421af3 columnFamilyName l 2023-07-24 00:06:11,836 INFO [StoreOpener-6d53b70fd383073a4b2f482854421af3-1] regionserver.HStore(310): Store=6d53b70fd383073a4b2f482854421af3/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:11,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:06:11,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:11,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d53b70fd383073a4b2f482854421af3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70000761, jitterRate=0.043092623353004456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:11,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d53b70fd383073a4b2f482854421af3: 2023-07-24 00:06:11,863 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3., pid=11, masterSystemTime=1690157171799 2023-07-24 00:06:11,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:06:11,867 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d53b70fd383073a4b2f482854421af3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:11,867 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690157171867"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157171867"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157171867"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157171867"}]},"ts":"1690157171867"} 2023-07-24 00:06:11,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 00:06:11,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6d53b70fd383073a4b2f482854421af3, server=jenkins-hbase4.apache.org,41155,1690157167693 in 226 msec 2023-07-24 00:06:11,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 00:06:11,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6d53b70fd383073a4b2f482854421af3, ASSIGN in 398 msec 2023-07-24 00:06:11,884 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:06:11,885 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157171884"}]},"ts":"1690157171884"} 2023-07-24 00:06:11,888 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 00:06:11,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:06:11,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 520 msec 2023-07-24 00:06:12,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 00:06:12,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 00:06:12,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 00:06:13,112 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:13,500 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:13,506 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33307_jobhistory____.ojqlh9/webapp 2023-07-24 00:06:13,693 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 00:06:13,693 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 00:06:13,693 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 00:06:13,696 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 00:06:13,785 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:14,134 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:14,561 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 00:06:14,651 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33307 2023-07-24 00:06:15,790 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:06:16,111 WARN [Listener at jenkins-hbase4.apache.org/41077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:16,136 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 00:06:16,138 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 00:06:16,139 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 00:06:16,145 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:16,146 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 00:06:16,146 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:16,146 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 00:06:16,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 00:06:16,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 00:06:16,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:16,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 00:06:16,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 00:06:16,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 00:06:16,222 WARN [Listener at jenkins-hbase4.apache.org/41077] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 00:06:16,223 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:16,229 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46811_cluster____.o77h6a/webapp 2023-07-24 00:06:16,307 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 00:06:16,307 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 00:06:16,307 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 00:06:16,308 INFO [Listener at jenkins-hbase4.apache.org/41077] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 00:06:16,318 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:16,529 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:16,673 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:16,687 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46811 2023-07-24 00:06:17,241 WARN [Listener at jenkins-hbase4.apache.org/37847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:17,274 WARN [Listener at jenkins-hbase4.apache.org/37847] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 00:06:17,274 INFO [Listener at jenkins-hbase4.apache.org/37847] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:17,284 INFO [Listener at jenkins-hbase4.apache.org/37847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34101_node____mlir3/webapp 2023-07-24 00:06:17,357 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 00:06:17,357 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 00:06:17,357 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 00:06:17,357 INFO [Listener at jenkins-hbase4.apache.org/37847] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 00:06:17,365 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:17,386 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:17,494 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:17,535 INFO [Listener at jenkins-hbase4.apache.org/37847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34101 2023-07-24 00:06:17,865 WARN [Listener at jenkins-hbase4.apache.org/43137] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 00:06:17,872 WARN [Listener at jenkins-hbase4.apache.org/43137] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 00:06:17,873 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 00:06:17,886 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35819_node____.lgrxfo/webapp 2023-07-24 00:06:17,956 INFO [Listener at jenkins-hbase4.apache.org/43137] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 00:06:17,957 INFO [Listener at jenkins-hbase4.apache.org/43137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 00:06:17,957 INFO [Listener at jenkins-hbase4.apache.org/43137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 00:06:17,957 INFO [Listener at jenkins-hbase4.apache.org/43137] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 00:06:17,968 INFO [Listener at jenkins-hbase4.apache.org/43137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:17,991 INFO [Listener at jenkins-hbase4.apache.org/43137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:18,092 INFO [Listener at jenkins-hbase4.apache.org/43137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 00:06:18,100 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35819 2023-07-24 00:06:18,142 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 00:06:18,144 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:18,210 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=139, ProcessCount=173, AvailableMemoryMB=7742 2023-07-24 00:06:18,210 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-24 00:06:18,225 DEBUG [Listener at jenkins-hbase4.apache.org/43137] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 00:06:18,231 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 00:06:18,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:18,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:18,245 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:06:18,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 00:06:18,248 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:06:18,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 00:06:18,252 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:18,252 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:18,255 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda empty. 2023-07-24 00:06:18,256 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 empty. 2023-07-24 00:06:18,256 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:18,257 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:18,257 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 00:06:18,333 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:18,335 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => df1af34a2664965a44cf140c17570dda, NAME => 'testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:18,335 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => cdc1ad097acb6f6be719068baec01621, NAME => 'testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:18,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 00:06:18,414 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:18,415 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing df1af34a2664965a44cf140c17570dda, disabling compactions & flushes 2023-07-24 00:06:18,415 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:18,416 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:18,416 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. after waiting 0 ms 2023-07-24 00:06:18,416 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:18,416 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:18,416 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for df1af34a2664965a44cf140c17570dda: 2023-07-24 00:06:18,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 00:06:18,810 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:18,810 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing cdc1ad097acb6f6be719068baec01621, disabling compactions & flushes 2023-07-24 00:06:18,810 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:18,810 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:18,810 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. after waiting 0 ms 2023-07-24 00:06:18,810 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:18,810 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:18,810 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for cdc1ad097acb6f6be719068baec01621: 2023-07-24 00:06:18,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:06:18,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157178818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157178818"}]},"ts":"1690157178818"} 2023-07-24 00:06:18,819 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157178818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157178818"}]},"ts":"1690157178818"} 2023-07-24 00:06:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 00:06:18,873 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:06:18,874 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:06:18,875 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157178875"}]},"ts":"1690157178875"} 2023-07-24 00:06:18,877 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 00:06:18,889 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:06:18,891 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:06:18,891 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:06:18,892 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:06:18,892 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:06:18,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, ASSIGN}] 2023-07-24 00:06:18,902 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, ASSIGN 2023-07-24 00:06:18,902 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, ASSIGN 2023-07-24 00:06:18,904 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:06:18,904 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34461,1690157167575; forceNewPlan=false, retain=false 2023-07-24 00:06:19,054 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:06:19,056 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cdc1ad097acb6f6be719068baec01621, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,056 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=df1af34a2664965a44cf140c17570dda, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,056 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157179056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157179056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157179056"}]},"ts":"1690157179056"} 2023-07-24 00:06:19,056 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157179056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157179056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157179056"}]},"ts":"1690157179056"} 2023-07-24 00:06:19,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure df1af34a2664965a44cf140c17570dda, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:06:19,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure cdc1ad097acb6f6be719068baec01621, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:06:19,214 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,214 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 00:06:19,218 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 00:06:19,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:19,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df1af34a2664965a44cf140c17570dda, NAME => 'testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 00:06:19,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. service=AccessControlService 2023-07-24 00:06:19,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:19,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:19,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:19,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cdc1ad097acb6f6be719068baec01621, NAME => 'testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 00:06:19,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. service=AccessControlService 2023-07-24 00:06:19,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:19,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:19,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,227 INFO [StoreOpener-df1af34a2664965a44cf140c17570dda-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,229 DEBUG [StoreOpener-df1af34a2664965a44cf140c17570dda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf 2023-07-24 00:06:19,229 DEBUG [StoreOpener-df1af34a2664965a44cf140c17570dda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf 2023-07-24 00:06:19,229 INFO [StoreOpener-cdc1ad097acb6f6be719068baec01621-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,230 INFO [StoreOpener-df1af34a2664965a44cf140c17570dda-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df1af34a2664965a44cf140c17570dda columnFamilyName cf 2023-07-24 00:06:19,231 INFO [StoreOpener-df1af34a2664965a44cf140c17570dda-1] regionserver.HStore(310): Store=df1af34a2664965a44cf140c17570dda/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:19,231 DEBUG [StoreOpener-cdc1ad097acb6f6be719068baec01621-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf 2023-07-24 00:06:19,232 DEBUG [StoreOpener-cdc1ad097acb6f6be719068baec01621-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf 2023-07-24 00:06:19,232 INFO [StoreOpener-cdc1ad097acb6f6be719068baec01621-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cdc1ad097acb6f6be719068baec01621 columnFamilyName cf 2023-07-24 00:06:19,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,233 INFO [StoreOpener-cdc1ad097acb6f6be719068baec01621-1] regionserver.HStore(310): Store=cdc1ad097acb6f6be719068baec01621/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:19,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:19,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:19,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:19,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened df1af34a2664965a44cf140c17570dda; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59970961, jitterRate=-0.10636304318904877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:19,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for df1af34a2664965a44cf140c17570dda: 2023-07-24 00:06:19,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda., pid=15, masterSystemTime=1690157179212 2023-07-24 00:06:19,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:19,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cdc1ad097acb6f6be719068baec01621; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68778572, jitterRate=0.024880588054656982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:19,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cdc1ad097acb6f6be719068baec01621: 2023-07-24 00:06:19,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:19,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621., pid=16, masterSystemTime=1690157179214 2023-07-24 00:06:19,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:19,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=df1af34a2664965a44cf140c17570dda, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157179254"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157179254"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157179254"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157179254"}]},"ts":"1690157179254"} 2023-07-24 00:06:19,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:19,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:19,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cdc1ad097acb6f6be719068baec01621, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,259 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157179257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157179257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157179257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157179257"}]},"ts":"1690157179257"} 2023-07-24 00:06:19,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-24 00:06:19,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure df1af34a2664965a44cf140c17570dda, server=jenkins-hbase4.apache.org,32955,1690157167636 in 201 msec 2023-07-24 00:06:19,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-24 00:06:19,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure cdc1ad097acb6f6be719068baec01621, server=jenkins-hbase4.apache.org,34461,1690157167575 in 202 msec 2023-07-24 00:06:19,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, ASSIGN in 372 msec 2023-07-24 00:06:19,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 00:06:19,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, ASSIGN in 374 msec 2023-07-24 00:06:19,271 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:06:19,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157179271"}]},"ts":"1690157179271"} 2023-07-24 00:06:19,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 00:06:19,278 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:06:19,284 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 00:06:19,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 00:06:19,344 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:19,344 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:19,344 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:19,344 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:19,344 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:06:19,352 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:19,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:19,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:19,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:19,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:19,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1130 sec 2023-07-24 00:06:19,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 00:06:19,361 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 00:06:19,361 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-24 00:06:19,362 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:19,367 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-24 00:06:19,367 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:19,367 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-24 00:06:19,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 00:06:19,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157179383 (current time:1690157179383). 2023-07-24 00:06:19,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:06:19,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x25b50a73 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:19,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61bd30fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:19,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:19,394 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:19,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25b50a73 to 127.0.0.1:56229 2023-07-24 00:06:19,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:19,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x35d1d0df to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4641495e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:19,406 DEBUG [hconnection-0x34c6838e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:19,407 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:19,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35d1d0df to 127.0.0.1:56229 2023-07-24 00:06:19,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:19,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 00:06:19,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:06:19,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 00:06:19,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 00:06:19,468 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 00:06:19,469 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690157779469 2023-07-24 00:06:19,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 00:06:19,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 00:06:19,472 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 00:06:19,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 00:06:19,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-24 00:06:19,476 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 00:06:19,477 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:06:19,477 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:06:19,478 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690157779478 2023-07-24 00:06:19,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,507 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 00:06:19,507 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:19,508 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 00:06:19,508 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 00:06:19,511 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,511 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:19,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:19,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:19,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:19,516 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,517 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:19,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,518 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,518 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,519 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,519 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:06:19,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 00:06:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 00:06:19,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 00:06:19,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 00:06:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 00:06:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 00:06:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 00:06:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:19,526 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 00:06:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 00:06:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 00:06:19,526 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 00:06:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 00:06:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 00:06:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 00:06:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 00:06:19,530 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,530 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,530 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:19,531 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16c7cd6b[Count = 1] remaining members to acquire global barrier 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:19,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 00:06:19,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16c7cd6b[Count = 0] remaining members to acquire global barrier 2023-07-24 00:06:19,537 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 00:06:19,537 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,539 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,539 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,539 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 00:06:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,540 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 00:06:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 00:06:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:06:19,540 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,540 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:06:19,541 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 00:06:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:19,546 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 00:06:19,547 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:19,547 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 00:06:19,551 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:19,551 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. started... 2023-07-24 00:06:19,551 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. started... 2023-07-24 00:06:19,554 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cdc1ad097acb6f6be719068baec01621: 2023-07-24 00:06:19,554 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for df1af34a2664965a44cf140c17570dda: 2023-07-24 00:06:19,555 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,555 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,561 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:19,561 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:19,565 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:06:19,565 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:06:19,577 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:19,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 00:06:19,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:19,583 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:06:19,611 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. completed. 2023-07-24 00:06:19,612 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 00:06:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:06:19,614 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 00:06:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:19,615 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:19,615 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 00:06:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:19,618 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. completed. 2023-07-24 00:06:19,618 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 00:06:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:06:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,622 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,622 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 00:06:19,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,622 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:19,622 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 00:06:19,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:06:19,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 00:06:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:19,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:19,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:19,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:06:19,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 00:06:19,632 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 00:06:19,632 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:06:19,632 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:06:19,632 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,632 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:06:19,636 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,636 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,636 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,636 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:19,636 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:19,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,636 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,637 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:19,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:19,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:19,638 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,638 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:19,639 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:19,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,641 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,642 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,643 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,658 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,659 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:19,659 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:19,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:19,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:19,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:19,659 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:19,659 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:19,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:19,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:19,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:19,660 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,660 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,660 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:19,661 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:19,661 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:19,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:19,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:19,662 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,662 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:19,662 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,662 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:19,663 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:19,663 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,663 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,663 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:19,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,784 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 00:06:19,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:19,792 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 00:06:19,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 00:06:19,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,825 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:19,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690157179470Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690157179663 (+193 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690157179664 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690157179682 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690157179722 (+40 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690157179824 (+102 ms) 2023-07-24 00:06:19,827 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 00:06:19,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 355 msec 2023-07-24 00:06:20,092 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:20,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 00:06:20,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:06:20,114 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:20,114 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:20,120 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:20,120 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:20,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34461] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:06:20,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:06:20,130 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 00:06:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:20,133 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:20,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 00:06:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157180164 (current time:1690157180164). 2023-07-24 00:06:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:06:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x4676ba67 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:20,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@104ae404, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:20,175 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:20,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4676ba67 to 127.0.0.1:56229 2023-07-24 00:06:20,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:20,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x64a846c8 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:20,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17fe6db8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:20,187 DEBUG [hconnection-0x5053d187-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:20,191 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:20,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64a846c8 to 127.0.0.1:56229 2023-07-24 00:06:20,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:20,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 00:06:20,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:06:20,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 00:06:20,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 00:06:20,207 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 00:06:20,209 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690157780209 2023-07-24 00:06:20,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 00:06:20,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 00:06:20,211 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:06:20,211 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:06:20,220 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 00:06:20,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 00:06:20,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-24 00:06:20,224 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 00:06:20,225 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690157780225 2023-07-24 00:06:20,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 00:06:20,258 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 00:06:20,259 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:20,260 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 00:06:20,260 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 00:06:20,261 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,261 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,262 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:20,262 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:20,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:20,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:20,262 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,262 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:20,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,263 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,263 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,264 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,264 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:06:20,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 00:06:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 00:06:20,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 00:06:20,265 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 00:06:20,265 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 00:06:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 00:06:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,266 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 00:06:20,266 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 00:06:20,266 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 00:06:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,266 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 00:06:20,267 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 00:06:20,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 00:06:20,269 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 00:06:20,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 00:06:20,269 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:20,269 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 00:06:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 00:06:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 00:06:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 00:06:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 00:06:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 00:06:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 00:06:20,271 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:20,272 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,273 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:20,274 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,274 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:20,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 00:06:20,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286f4f52[Count = 1] remaining members to acquire global barrier 2023-07-24 00:06:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:20,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 00:06:20,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286f4f52[Count = 0] remaining members to acquire global barrier 2023-07-24 00:06:20,280 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 00:06:20,280 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,286 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 00:06:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 00:06:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:06:20,286 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 00:06:20,286 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 00:06:20,287 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,287 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:06:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:20,287 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:20,287 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. started... 2023-07-24 00:06:20,287 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing df1af34a2664965a44cf140c17570dda 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 00:06:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:20,290 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 00:06:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 00:06:20,290 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. started... 2023-07-24 00:06:20,291 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cdc1ad097acb6f6be719068baec01621 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 00:06:20,312 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:20,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 00:06:20,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:20,314 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:06:20,389 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/.tmp/cf/1c6353a547b54cd3ad0697b355721ebc 2023-07-24 00:06:20,390 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/.tmp/cf/9eba664556d0452096e6cef11fdca11a 2023-07-24 00:06:20,443 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/.tmp/cf/1c6353a547b54cd3ad0697b355721ebc as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf/1c6353a547b54cd3ad0697b355721ebc 2023-07-24 00:06:20,443 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/.tmp/cf/9eba664556d0452096e6cef11fdca11a as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf/9eba664556d0452096e6cef11fdca11a 2023-07-24 00:06:20,453 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf/1c6353a547b54cd3ad0697b355721ebc, entries=46, sequenceid=6, filesize=7.9 K 2023-07-24 00:06:20,455 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf/9eba664556d0452096e6cef11fdca11a, entries=4, sequenceid=6, filesize=5.1 K 2023-07-24 00:06:20,459 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for cdc1ad097acb6f6be719068baec01621 in 168ms, sequenceid=6, compaction requested=false 2023-07-24 00:06:20,459 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for df1af34a2664965a44cf140c17570dda in 172ms, sequenceid=6, compaction requested=false 2023-07-24 00:06:20,459 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 00:06:20,459 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 00:06:20,461 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for df1af34a2664965a44cf140c17570dda: 2023-07-24 00:06:20,461 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cdc1ad097acb6f6be719068baec01621: 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf/1c6353a547b54cd3ad0697b355721ebc] hfiles 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf/1c6353a547b54cd3ad0697b355721ebc for snapshot=snaptb0-testExportWithTargetName 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf/9eba664556d0452096e6cef11fdca11a] hfiles 2023-07-24 00:06:20,462 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf/9eba664556d0452096e6cef11fdca11a for snapshot=snaptb0-testExportWithTargetName 2023-07-24 00:06:20,491 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. completed. 2023-07-24 00:06:20,492 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:20,492 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:20,492 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:20,492 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,492 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 00:06:20,492 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:06:20,494 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 00:06:20,494 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. completed. 2023-07-24 00:06:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:20,495 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 00:06:20,494 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 00:06:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:06:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 00:06:20,500 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 00:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:06:20,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 00:06:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:06:20,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 00:06:20,512 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 00:06:20,512 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:06:20,512 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:06:20,512 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 00:06:20,512 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:06:20,514 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:20,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:20,515 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:20,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:20,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:20,517 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:20,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,518 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:20,518 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:20,522 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 00:06:20,522 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,523 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 00:06:20,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,524 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 00:06:20,553 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:20,553 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:20,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:20,553 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:20,554 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:20,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:20,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:20,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:20,562 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,562 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:20,562 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:20,562 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:20,562 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:20,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 00:06:20,562 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,563 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,564 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,564 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:20,565 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,565 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:20,565 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:20,565 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,565 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 00:06:20,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:20,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:20,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 00:06:20,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 00:06:20,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690157180210Consolidate snapshot: snaptb0-testExportWithTargetName at 1690157180563 (+353 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690157180565 (+2 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690157180584 (+19 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690157180614 (+30 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690157180671 (+57 ms) 2023-07-24 00:06:20,674 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 00:06:20,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 463 msec 2023-07-24 00:06:20,824 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:20,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 00:06:20,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:06:20,828 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828 2023-07-24 00:06:20,828 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46711, tgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828, rawTgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:20,871 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:20,871 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_113434741_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 00:06:20,871 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 00:06:20,892 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 00:06:20,963 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:20,963 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:20,964 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:20,964 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,007 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-8289129754900558223.jar 2023-07-24 00:06:22,007 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,008 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,075 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-3939687304818475997.jar 2023-07-24 00:06:22,076 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,076 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,077 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,077 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,077 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,078 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:22,078 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:06:22,079 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:06:22,079 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:06:22,080 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:06:22,080 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:06:22,081 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:06:22,081 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:06:22,082 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:06:22,082 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:06:22,083 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:06:22,086 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:22,087 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:22,087 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:22,088 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:22,088 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:22,089 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:22,090 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:23,104 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:06:23,111 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 00:06:23,122 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 00:06:23,594 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:06:23,596 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:06:23,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0001_000001 (auth:SIMPLE) 2023-07-24 00:06:24,744 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:06:28,930 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0001_000001 (auth:SIMPLE) 2023-07-24 00:06:31,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0001_000001 (auth:SIMPLE) 2023-07-24 00:06:34,782 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0001_000001 (auth:SIMPLE) 2023-07-24 00:06:36,054 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:06:36,057 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:06:36,077 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 00:06:36,077 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:06:36,078 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:06:36,078 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 00:06:36,079 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 00:06:36,079 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 00:06:36,079 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828/.hbase-snapshot/testExportWithTargetName 2023-07-24 00:06:36,080 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 00:06:36,080 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157180828/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 00:06:36,095 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 00:06:36,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 00:06:36,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157196115"}]},"ts":"1690157196115"} 2023-07-24 00:06:36,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 00:06:36,118 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 00:06:36,120 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 00:06:36,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, UNASSIGN}] 2023-07-24 00:06:36,124 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, UNASSIGN 2023-07-24 00:06:36,124 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, UNASSIGN 2023-07-24 00:06:36,125 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cdc1ad097acb6f6be719068baec01621, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:36,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=df1af34a2664965a44cf140c17570dda, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:36,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157196125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157196125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157196125"}]},"ts":"1690157196125"} 2023-07-24 00:06:36,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157196125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157196125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157196125"}]},"ts":"1690157196125"} 2023-07-24 00:06:36,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure cdc1ad097acb6f6be719068baec01621, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:06:36,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure df1af34a2664965a44cf140c17570dda, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:06:36,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 00:06:36,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cdc1ad097acb6f6be719068baec01621, disabling compactions & flushes 2023-07-24 00:06:36,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. after waiting 0 ms 2023-07-24 00:06:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:36,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:36,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing df1af34a2664965a44cf140c17570dda, disabling compactions & flushes 2023-07-24 00:06:36,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:36,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:36,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. after waiting 0 ms 2023-07-24 00:06:36,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:36,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:06:36,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:06:36,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:36,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:36,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621. 2023-07-24 00:06:36,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda. 2023-07-24 00:06:36,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cdc1ad097acb6f6be719068baec01621: 2023-07-24 00:06:36,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for df1af34a2664965a44cf140c17570dda: 2023-07-24 00:06:36,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:36,320 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=df1af34a2664965a44cf140c17570dda, regionState=CLOSED 2023-07-24 00:06:36,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:36,320 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157196320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157196320"}]},"ts":"1690157196320"} 2023-07-24 00:06:36,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cdc1ad097acb6f6be719068baec01621, regionState=CLOSED 2023-07-24 00:06:36,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690157196321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157196321"}]},"ts":"1690157196321"} 2023-07-24 00:06:36,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 00:06:36,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure df1af34a2664965a44cf140c17570dda, server=jenkins-hbase4.apache.org,32955,1690157167636 in 193 msec 2023-07-24 00:06:36,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 00:06:36,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure cdc1ad097acb6f6be719068baec01621, server=jenkins-hbase4.apache.org,34461,1690157167575 in 196 msec 2023-07-24 00:06:36,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=df1af34a2664965a44cf140c17570dda, UNASSIGN in 204 msec 2023-07-24 00:06:36,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 00:06:36,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cdc1ad097acb6f6be719068baec01621, UNASSIGN in 205 msec 2023-07-24 00:06:36,335 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157196334"}]},"ts":"1690157196334"} 2023-07-24 00:06:36,336 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 00:06:36,338 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 00:06:36,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 234 msec 2023-07-24 00:06:36,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 00:06:36,420 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 00:06:36,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 00:06:36,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,435 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 00:06:36,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,440 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 00:06:36,443 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:36,443 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:36,444 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,444 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,444 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,444 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 00:06:36,445 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 00:06:36,445 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 00:06:36,445 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 00:06:36,445 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,445 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,446 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,445 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:36,445 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 00:06:36,446 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:36,446 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:36,446 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:36,448 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/recovered.edits] 2023-07-24 00:06:36,449 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/recovered.edits] 2023-07-24 00:06:36,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 00:06:36,456 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf/9eba664556d0452096e6cef11fdca11a to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/cf/9eba664556d0452096e6cef11fdca11a 2023-07-24 00:06:36,457 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf/1c6353a547b54cd3ad0697b355721ebc to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/cf/1c6353a547b54cd3ad0697b355721ebc 2023-07-24 00:06:36,461 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621/recovered.edits/9.seqid 2023-07-24 00:06:36,461 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda/recovered.edits/9.seqid 2023-07-24 00:06:36,462 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/cdc1ad097acb6f6be719068baec01621 2023-07-24 00:06:36,462 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportWithTargetName/df1af34a2664965a44cf140c17570dda 2023-07-24 00:06:36,462 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 00:06:36,465 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,495 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 00:06:36,498 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 00:06:36,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 00:06:36,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157196501"}]},"ts":"9223372036854775807"} 2023-07-24 00:06:36,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157196501"}]},"ts":"9223372036854775807"} 2023-07-24 00:06:36,505 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 00:06:36,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cdc1ad097acb6f6be719068baec01621, NAME => 'testtb-testExportWithTargetName,,1690157178239.cdc1ad097acb6f6be719068baec01621.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => df1af34a2664965a44cf140c17570dda, NAME => 'testtb-testExportWithTargetName,1,1690157178239.df1af34a2664965a44cf140c17570dda.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 00:06:36,506 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 00:06:36,506 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157196506"}]},"ts":"9223372036854775807"} 2023-07-24 00:06:36,508 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 00:06:36,511 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 00:06:36,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 85 msec 2023-07-24 00:06:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 00:06:36,551 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 00:06:36,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 00:06:36,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 00:06:36,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 00:06:36,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 00:06:36,615 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=759 (was 709) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:52116 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:33589 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2067262132_1 at /127.0.0.1:40696 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:40730 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:41393 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:43137 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:59744 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=298 (was 139) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=5934 (was 7742) 2023-07-24 00:06:36,615 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 00:06:36,640 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=759, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=298, ProcessCount=182, AvailableMemoryMB=5928 2023-07-24 00:06:36,640 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 00:06:36,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:36,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:36,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:06:36,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 00:06:36,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:06:36,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 00:06:36,653 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:36,653 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:36,653 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 empty. 2023-07-24 00:06:36,653 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 empty. 2023-07-24 00:06:36,654 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:36,654 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:36,654 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 00:06:36,667 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:36,670 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b8e50d4126486c2fe97011e3aef6d88, NAME => 'testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:36,670 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 59e16a7f9dd56e7d95c4bbaf773c55f0, NAME => 'testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:36,699 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:36,700 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5b8e50d4126486c2fe97011e3aef6d88, disabling compactions & flushes 2023-07-24 00:06:36,700 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:36,700 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:36,700 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. after waiting 0 ms 2023-07-24 00:06:36,700 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:36,700 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:36,700 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5b8e50d4126486c2fe97011e3aef6d88: 2023-07-24 00:06:36,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 00:06:36,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 00:06:37,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:37,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 59e16a7f9dd56e7d95c4bbaf773c55f0, disabling compactions & flushes 2023-07-24 00:06:37,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. after waiting 0 ms 2023-07-24 00:06:37,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 59e16a7f9dd56e7d95c4bbaf773c55f0: 2023-07-24 00:06:37,097 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:06:37,099 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157197098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157197098"}]},"ts":"1690157197098"} 2023-07-24 00:06:37,099 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157197098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157197098"}]},"ts":"1690157197098"} 2023-07-24 00:06:37,102 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:06:37,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:06:37,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157197104"}]},"ts":"1690157197104"} 2023-07-24 00:06:37,107 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 00:06:37,112 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:06:37,114 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:06:37,114 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:06:37,114 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:06:37,114 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:06:37,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, ASSIGN}] 2023-07-24 00:06:37,119 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, ASSIGN 2023-07-24 00:06:37,119 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, ASSIGN 2023-07-24 00:06:37,122 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34461,1690157167575; forceNewPlan=false, retain=false 2023-07-24 00:06:37,122 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:06:37,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 00:06:37,272 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:06:37,276 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=59e16a7f9dd56e7d95c4bbaf773c55f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,276 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5b8e50d4126486c2fe97011e3aef6d88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,276 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157197276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157197276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157197276"}]},"ts":"1690157197276"} 2023-07-24 00:06:37,276 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157197275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157197275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157197275"}]},"ts":"1690157197275"} 2023-07-24 00:06:37,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 59e16a7f9dd56e7d95c4bbaf773c55f0, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:06:37,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 5b8e50d4126486c2fe97011e3aef6d88, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:06:37,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59e16a7f9dd56e7d95c4bbaf773c55f0, NAME => 'testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 00:06:37,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. service=AccessControlService 2023-07-24 00:06:37,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:37,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:37,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:37,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b8e50d4126486c2fe97011e3aef6d88, NAME => 'testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 00:06:37,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. service=AccessControlService 2023-07-24 00:06:37,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:37,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:37,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,438 INFO [StoreOpener-59e16a7f9dd56e7d95c4bbaf773c55f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,439 INFO [StoreOpener-5b8e50d4126486c2fe97011e3aef6d88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,440 DEBUG [StoreOpener-59e16a7f9dd56e7d95c4bbaf773c55f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf 2023-07-24 00:06:37,440 DEBUG [StoreOpener-59e16a7f9dd56e7d95c4bbaf773c55f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf 2023-07-24 00:06:37,440 INFO [StoreOpener-59e16a7f9dd56e7d95c4bbaf773c55f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59e16a7f9dd56e7d95c4bbaf773c55f0 columnFamilyName cf 2023-07-24 00:06:37,441 DEBUG [StoreOpener-5b8e50d4126486c2fe97011e3aef6d88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf 2023-07-24 00:06:37,441 DEBUG [StoreOpener-5b8e50d4126486c2fe97011e3aef6d88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf 2023-07-24 00:06:37,441 INFO [StoreOpener-59e16a7f9dd56e7d95c4bbaf773c55f0-1] regionserver.HStore(310): Store=59e16a7f9dd56e7d95c4bbaf773c55f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:37,443 INFO [StoreOpener-5b8e50d4126486c2fe97011e3aef6d88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b8e50d4126486c2fe97011e3aef6d88 columnFamilyName cf 2023-07-24 00:06:37,444 INFO [StoreOpener-5b8e50d4126486c2fe97011e3aef6d88-1] regionserver.HStore(310): Store=5b8e50d4126486c2fe97011e3aef6d88/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:37,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:37,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:37,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b8e50d4126486c2fe97011e3aef6d88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74354253, jitterRate=0.10796470940113068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:37,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59e16a7f9dd56e7d95c4bbaf773c55f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70473555, jitterRate=0.050137802958488464}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b8e50d4126486c2fe97011e3aef6d88: 2023-07-24 00:06:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59e16a7f9dd56e7d95c4bbaf773c55f0: 2023-07-24 00:06:37,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88., pid=31, masterSystemTime=1690157197433 2023-07-24 00:06:37,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0., pid=30, masterSystemTime=1690157197431 2023-07-24 00:06:37,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:37,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:37,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5b8e50d4126486c2fe97011e3aef6d88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157197465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157197465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157197465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157197465"}]},"ts":"1690157197465"} 2023-07-24 00:06:37,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,466 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=59e16a7f9dd56e7d95c4bbaf773c55f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157197466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157197466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157197466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157197466"}]},"ts":"1690157197466"} 2023-07-24 00:06:37,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-24 00:06:37,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 5b8e50d4126486c2fe97011e3aef6d88, server=jenkins-hbase4.apache.org,32955,1690157167636 in 190 msec 2023-07-24 00:06:37,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-24 00:06:37,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 59e16a7f9dd56e7d95c4bbaf773c55f0, server=jenkins-hbase4.apache.org,34461,1690157167575 in 192 msec 2023-07-24 00:06:37,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, ASSIGN in 359 msec 2023-07-24 00:06:37,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-24 00:06:37,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, ASSIGN in 363 msec 2023-07-24 00:06:37,482 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:06:37,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157197482"}]},"ts":"1690157197482"} 2023-07-24 00:06:37,484 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 00:06:37,487 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:06:37,487 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 00:06:37,489 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 00:06:37,491 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:37,491 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:37,491 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:37,491 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:37,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 849 msec 2023-07-24 00:06:37,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 00:06:37,765 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 00:06:37,765 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 00:06:37,765 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:37,770 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 00:06:37,771 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:37,771 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-24 00:06:37,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:06:37,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157197791 (current time:1690157197791). 2023-07-24 00:06:37,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:06:37,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x45ca8c0a to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:37,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@343de2b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:37,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:37,805 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45ca8c0a to 127.0.0.1:56229 2023-07-24 00:06:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:37,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x5e64a78e to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:37,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f5fda94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:37,823 DEBUG [hconnection-0x14ac99bf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:37,826 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:37,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e64a78e to 127.0.0.1:56229 2023-07-24 00:06:37,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:37,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 00:06:37,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:06:37,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:06:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:06:37,848 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:06:37,850 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690157797850 2023-07-24 00:06:37,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 00:06:37,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:06:37,852 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:06:37,852 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:06:37,854 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:06:37,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 00:06:37,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 19 msec 2023-07-24 00:06:37,857 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 00:06:37,858 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690157797858 2023-07-24 00:06:37,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,900 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 00:06:37,900 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:37,902 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 00:06:37,902 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 00:06:37,936 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,937 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,939 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:37,939 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:37,939 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,939 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:37,939 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:37,940 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,940 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,940 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:06:37,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,941 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 00:06:37,941 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 00:06:37,941 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:37,941 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:37,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,944 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 00:06:37,944 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 00:06:37,944 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:37,943 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 00:06:37,945 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 00:06:37,945 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 00:06:37,945 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 00:06:37,944 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 00:06:37,945 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 00:06:37,945 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 00:06:37,945 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 00:06:37,946 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,946 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:37,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:37,952 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:37,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:06:37,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:37,954 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,954 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:06:37,954 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:37,954 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:37,954 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,954 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:37,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:37,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 00:06:37,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fdf3ed7[Count = 1] remaining members to acquire global barrier 2023-07-24 00:06:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:37,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 00:06:37,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fdf3ed7[Count = 0] remaining members to acquire global barrier 2023-07-24 00:06:37,959 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 00:06:37,959 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,960 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,960 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,960 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 00:06:37,961 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:37,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,961 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:37,961 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. started... 2023-07-24 00:06:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:06:37,961 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,961 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:06:37,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:37,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:37,963 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b8e50d4126486c2fe97011e3aef6d88: 2023-07-24 00:06:37,963 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,963 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. started... 2023-07-24 00:06:37,963 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,964 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59e16a7f9dd56e7d95c4bbaf773c55f0: 2023-07-24 00:06:37,964 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:37,964 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 00:06:37,964 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:06:37,965 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,964 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:37,965 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:37,965 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 00:06:37,965 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:06:37,987 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. completed. 2023-07-24 00:06:37,987 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 00:06:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:06:37,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:37,989 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 00:06:37,990 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:37,990 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 00:06:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:37,992 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. completed. 2023-07-24 00:06:37,992 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:37,993 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:37,993 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:37,993 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,993 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 00:06:37,993 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:06:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,995 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,995 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 00:06:37,995 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:37,996 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 00:06:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:06:38,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 00:06:38,007 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 00:06:38,007 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:06:38,007 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:06:38,007 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,007 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:06:38,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,010 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,011 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,012 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,012 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,015 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,015 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,016 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,018 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,018 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,018 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,018 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,018 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,019 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,019 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,018 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,019 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,019 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:38,019 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,022 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,103 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 00:06:38,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,104 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:38,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690157197850Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690157198019 (+169 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690157198019Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690157198030 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690157198052 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690157198103 (+51 ms) 2023-07-24 00:06:38,107 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 00:06:38,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 255 msec 2023-07-24 00:06:38,154 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:38,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:06:38,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:06:38,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:06:38,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34461] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:06:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 00:06:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:38,183 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:38,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:06:38,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157198205 (current time:1690157198205). 2023-07-24 00:06:38,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:06:38,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x62bd6e54 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:38,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12904262, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:38,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:38,224 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:38,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62bd6e54 to 127.0.0.1:56229 2023-07-24 00:06:38,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:38,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x74e05392 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:38,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db58200, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:38,257 DEBUG [hconnection-0x34dc2249-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:38,259 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74e05392 to 127.0.0.1:56229 2023-07-24 00:06:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 00:06:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:06:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:06:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:06:38,273 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:06:38,275 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690157798275 2023-07-24 00:06:38,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 00:06:38,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:06:38,277 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:06:38,277 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:06:38,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 00:06:38,284 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:06:38,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-24 00:06:38,287 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 00:06:38,288 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690157798288 2023-07-24 00:06:38,377 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:38,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:06:38,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:38,379 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:06:38,579 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:38,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:06:38,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:38,581 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 00:06:38,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 00:06:38,711 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 00:06:38,711 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:38,711 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 00:06:38,711 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 00:06:38,712 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,712 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,713 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,713 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,713 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,713 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,714 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,714 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,714 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,714 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 00:06:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 00:06:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 00:06:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 00:06:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:38,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 00:06:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 00:06:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 00:06:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 00:06:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 00:06:38,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 00:06:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 00:06:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 00:06:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 00:06:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 00:06:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 00:06:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 00:06:38,727 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,727 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,727 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,727 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:38,727 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,727 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d18efa1[Count = 1] remaining members to acquire global barrier 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 00:06:38,732 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 00:06:38,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d18efa1[Count = 0] remaining members to acquire global barrier 2023-07-24 00:06:38,732 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,733 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,733 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,733 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:06:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:38,734 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:38,734 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:38,734 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. started... 2023-07-24 00:06:38,734 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. started... 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:06:38,734 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,734 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b8e50d4126486c2fe97011e3aef6d88 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 00:06:38,735 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 59e16a7f9dd56e7d95c4bbaf773c55f0 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 00:06:38,734 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:38,735 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:38,735 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:06:38,736 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 00:06:38,736 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:38,736 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 00:06:38,754 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/.tmp/cf/9ff72ce5a74149f18b2a429922a0b189 2023-07-24 00:06:38,754 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/.tmp/cf/421262360104465db16497d8a63fc5b1 2023-07-24 00:06:38,765 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/.tmp/cf/9ff72ce5a74149f18b2a429922a0b189 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf/9ff72ce5a74149f18b2a429922a0b189 2023-07-24 00:06:38,765 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/.tmp/cf/421262360104465db16497d8a63fc5b1 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf/421262360104465db16497d8a63fc5b1 2023-07-24 00:06:38,771 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf/9ff72ce5a74149f18b2a429922a0b189, entries=5, sequenceid=6, filesize=5.2 K 2023-07-24 00:06:38,772 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf/421262360104465db16497d8a63fc5b1, entries=45, sequenceid=6, filesize=7.9 K 2023-07-24 00:06:38,776 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5b8e50d4126486c2fe97011e3aef6d88 in 42ms, sequenceid=6, compaction requested=false 2023-07-24 00:06:38,776 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 59e16a7f9dd56e7d95c4bbaf773c55f0 in 42ms, sequenceid=6, compaction requested=false 2023-07-24 00:06:38,776 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 00:06:38,777 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b8e50d4126486c2fe97011e3aef6d88: 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59e16a7f9dd56e7d95c4bbaf773c55f0: 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf/9ff72ce5a74149f18b2a429922a0b189] hfiles 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf/421262360104465db16497d8a63fc5b1] hfiles 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf/9ff72ce5a74149f18b2a429922a0b189 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 00:06:38,779 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf/421262360104465db16497d8a63fc5b1 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 00:06:38,792 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. completed. 2023-07-24 00:06:38,792 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 00:06:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:06:38,794 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. completed. 2023-07-24 00:06:38,795 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 00:06:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:06:38,799 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 00:06:38,799 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,799 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,799 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 00:06:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 00:06:38,802 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 00:06:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:06:38,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 00:06:38,811 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 00:06:38,811 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:06:38,811 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:06:38,811 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 00:06:38,811 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:06:38,812 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,813 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:38,813 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,813 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:38,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,814 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,814 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,817 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:38,817 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 00:06:38,818 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,821 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 00:06:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 00:06:38,821 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:38,823 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,823 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,824 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:38,824 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,824 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:38,824 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:38,824 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,824 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:38,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 00:06:38,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,874 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690157198275Consolidate snapshot: snaptb0-testExportFileSystemState at 1690157198823 (+548 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690157198823Writing data manifest for snaptb0-testExportFileSystemState at 1690157198827 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690157198836 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690157198873 (+37 ms) 2023-07-24 00:06:38,877 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 00:06:38,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 600 msec 2023-07-24 00:06:38,881 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:38,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:06:38,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:06:38,883 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883 2023-07-24 00:06:38,883 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46711, tgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883, rawTgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:38,915 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:38,915 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_157002268_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,915 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 00:06:38,930 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 00:06:38,966 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:38,967 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:38,967 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:38,968 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,916 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-7107545213098808825.jar 2023-07-24 00:06:39,917 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,917 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,985 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-2843293227657531221.jar 2023-07-24 00:06:39,986 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,986 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,987 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,987 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,988 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,988 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:39,988 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:06:39,989 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:06:39,990 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:06:39,990 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:06:39,991 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:06:39,992 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:06:39,992 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:06:39,993 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:06:39,993 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:06:39,994 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:06:39,995 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:39,996 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:39,997 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:39,997 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:39,997 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:39,998 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:39,999 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:40,504 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:06:40,507 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 00:06:40,510 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 00:06:41,020 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:06:41,021 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:06:41,028 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0001_000001 (auth:SIMPLE) 2023-07-24 00:06:41,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0002_000001 (auth:SIMPLE) 2023-07-24 00:06:41,910 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:06:46,315 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0002_000001 (auth:SIMPLE) 2023-07-24 00:06:48,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0002_000001 (auth:SIMPLE) 2023-07-24 00:06:52,725 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:06:52,727 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:06:52,740 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 00:06:52,740 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:06:52,741 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:06:52,741 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 00:06:52,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 00:06:52,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 00:06:52,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 00:06:52,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 00:06:52,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157198883/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 00:06:52,754 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 00:06:52,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 00:06:52,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:52,762 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157212762"}]},"ts":"1690157212762"} 2023-07-24 00:06:52,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 00:06:52,764 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 00:06:52,766 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 00:06:52,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, UNASSIGN}] 2023-07-24 00:06:52,770 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, UNASSIGN 2023-07-24 00:06:52,770 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, UNASSIGN 2023-07-24 00:06:52,771 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=59e16a7f9dd56e7d95c4bbaf773c55f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:52,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157212771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157212771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157212771"}]},"ts":"1690157212771"} 2023-07-24 00:06:52,773 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5b8e50d4126486c2fe97011e3aef6d88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:52,773 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157212772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157212772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157212772"}]},"ts":"1690157212772"} 2023-07-24 00:06:52,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 59e16a7f9dd56e7d95c4bbaf773c55f0, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:06:52,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 5b8e50d4126486c2fe97011e3aef6d88, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:06:52,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 00:06:52,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:52,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59e16a7f9dd56e7d95c4bbaf773c55f0, disabling compactions & flushes 2023-07-24 00:06:52,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:52,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:52,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. after waiting 0 ms 2023-07-24 00:06:52,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:52,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:52,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b8e50d4126486c2fe97011e3aef6d88, disabling compactions & flushes 2023-07-24 00:06:52,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:52,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:52,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. after waiting 0 ms 2023-07-24 00:06:52,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:52,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:06:52,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:06:52,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:52,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88. 2023-07-24 00:06:52,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b8e50d4126486c2fe97011e3aef6d88: 2023-07-24 00:06:52,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:06:52,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0. 2023-07-24 00:06:52,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59e16a7f9dd56e7d95c4bbaf773c55f0: 2023-07-24 00:06:52,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:52,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5b8e50d4126486c2fe97011e3aef6d88, regionState=CLOSED 2023-07-24 00:06:52,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157212984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157212984"}]},"ts":"1690157212984"} 2023-07-24 00:06:52,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:52,990 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=59e16a7f9dd56e7d95c4bbaf773c55f0, regionState=CLOSED 2023-07-24 00:06:52,990 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690157212990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157212990"}]},"ts":"1690157212990"} 2023-07-24 00:06:52,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-24 00:06:52,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 5b8e50d4126486c2fe97011e3aef6d88, server=jenkins-hbase4.apache.org,32955,1690157167636 in 211 msec 2023-07-24 00:06:52,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5b8e50d4126486c2fe97011e3aef6d88, UNASSIGN in 226 msec 2023-07-24 00:06:52,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-24 00:06:52,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 59e16a7f9dd56e7d95c4bbaf773c55f0, server=jenkins-hbase4.apache.org,34461,1690157167575 in 219 msec 2023-07-24 00:06:52,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 00:06:52,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59e16a7f9dd56e7d95c4bbaf773c55f0, UNASSIGN in 229 msec 2023-07-24 00:06:53,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157213000"}]},"ts":"1690157213000"} 2023-07-24 00:06:53,002 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 00:06:53,004 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 00:06:53,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 250 msec 2023-07-24 00:06:53,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 00:06:53,066 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 00:06:53,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 00:06:53,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:53,071 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:53,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 00:06:53,072 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:53,074 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 00:06:53,077 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,077 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,077 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,078 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 00:06:53,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 00:06:53,078 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:53,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 00:06:53,078 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:53,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 00:06:53,079 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,079 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,079 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,080 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,080 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,080 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,080 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 00:06:53,080 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 00:06:53,081 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/recovered.edits] 2023-07-24 00:06:53,081 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/recovered.edits] 2023-07-24 00:06:53,086 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf/9ff72ce5a74149f18b2a429922a0b189 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/cf/9ff72ce5a74149f18b2a429922a0b189 2023-07-24 00:06:53,086 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf/421262360104465db16497d8a63fc5b1 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/cf/421262360104465db16497d8a63fc5b1 2023-07-24 00:06:53,090 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88/recovered.edits/9.seqid 2023-07-24 00:06:53,090 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0/recovered.edits/9.seqid 2023-07-24 00:06:53,091 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/5b8e50d4126486c2fe97011e3aef6d88 2023-07-24 00:06:53,091 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemState/59e16a7f9dd56e7d95c4bbaf773c55f0 2023-07-24 00:06:53,091 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 00:06:53,094 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:53,096 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 00:06:53,098 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 00:06:53,100 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:53,100 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 00:06:53,100 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157213100"}]},"ts":"9223372036854775807"} 2023-07-24 00:06:53,100 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157213100"}]},"ts":"9223372036854775807"} 2023-07-24 00:06:53,103 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 00:06:53,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b8e50d4126486c2fe97011e3aef6d88, NAME => 'testtb-testExportFileSystemState,,1690157196642.5b8e50d4126486c2fe97011e3aef6d88.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 59e16a7f9dd56e7d95c4bbaf773c55f0, NAME => 'testtb-testExportFileSystemState,1,1690157196642.59e16a7f9dd56e7d95c4bbaf773c55f0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 00:06:53,103 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 00:06:53,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157213103"}]},"ts":"9223372036854775807"} 2023-07-24 00:06:53,105 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 00:06:53,107 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 00:06:53,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 40 msec 2023-07-24 00:06:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 00:06:53,183 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 00:06:53,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 00:06:53,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 00:06:53,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 00:06:53,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 00:06:53,233 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 759) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:36734 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:41072 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:35643 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_474523087_1 at /127.0.0.1:41056 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_474523087_1 at /127.0.0.1:56496 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2065 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:56524 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 298) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=5597 (was 5928) 2023-07-24 00:06:53,234 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-24 00:06:53,258 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=182, AvailableMemoryMB=5594 2023-07-24 00:06:53,259 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-24 00:06:53,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:06:53,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:06:53,265 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:06:53,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 00:06:53,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 00:06:53,267 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:06:53,271 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,271 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,272 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 empty. 2023-07-24 00:06:53,272 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 empty. 2023-07-24 00:06:53,272 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,272 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,272 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 00:06:53,327 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 00:06:53,329 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41339753e8648ddea94256683ab37198, NAME => 'testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:53,329 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 333dee91ef1549cb98c562d7cf81c799, NAME => 'testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:06:53,362 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:53,363 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 41339753e8648ddea94256683ab37198, disabling compactions & flushes 2023-07-24 00:06:53,363 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,363 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,363 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. after waiting 0 ms 2023-07-24 00:06:53,363 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,363 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,363 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 41339753e8648ddea94256683ab37198: 2023-07-24 00:06:53,364 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:53,365 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 333dee91ef1549cb98c562d7cf81c799, disabling compactions & flushes 2023-07-24 00:06:53,365 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,365 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,365 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. after waiting 0 ms 2023-07-24 00:06:53,365 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,365 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,365 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 333dee91ef1549cb98c562d7cf81c799: 2023-07-24 00:06:53,368 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:06:53,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 00:06:53,369 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157213369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157213369"}]},"ts":"1690157213369"} 2023-07-24 00:06:53,369 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157213369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157213369"}]},"ts":"1690157213369"} 2023-07-24 00:06:53,371 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:06:53,372 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:06:53,372 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157213372"}]},"ts":"1690157213372"} 2023-07-24 00:06:53,373 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 00:06:53,380 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:06:53,381 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:06:53,381 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:06:53,381 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:06:53,381 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:06:53,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, ASSIGN}] 2023-07-24 00:06:53,384 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, ASSIGN 2023-07-24 00:06:53,384 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, ASSIGN 2023-07-24 00:06:53,385 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:06:53,385 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41155,1690157167693; forceNewPlan=false, retain=false 2023-07-24 00:06:53,535 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:06:53,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=41339753e8648ddea94256683ab37198, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:53,538 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=333dee91ef1549cb98c562d7cf81c799, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:53,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157213537"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157213537"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157213537"}]},"ts":"1690157213537"} 2023-07-24 00:06:53,538 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157213537"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157213537"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157213537"}]},"ts":"1690157213537"} 2023-07-24 00:06:53,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 333dee91ef1549cb98c562d7cf81c799, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:06:53,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 41339753e8648ddea94256683ab37198, server=jenkins-hbase4.apache.org,41155,1690157167693}] 2023-07-24 00:06:53,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 00:06:53,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 333dee91ef1549cb98c562d7cf81c799, NAME => 'testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 00:06:53,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. service=AccessControlService 2023-07-24 00:06:53,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,705 INFO [StoreOpener-333dee91ef1549cb98c562d7cf81c799-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41339753e8648ddea94256683ab37198, NAME => 'testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 00:06:53,707 DEBUG [StoreOpener-333dee91ef1549cb98c562d7cf81c799-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf 2023-07-24 00:06:53,707 DEBUG [StoreOpener-333dee91ef1549cb98c562d7cf81c799-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf 2023-07-24 00:06:53,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. service=AccessControlService 2023-07-24 00:06:53,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:06:53,708 INFO [StoreOpener-333dee91ef1549cb98c562d7cf81c799-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 333dee91ef1549cb98c562d7cf81c799 columnFamilyName cf 2023-07-24 00:06:53,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:06:53,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,709 INFO [StoreOpener-333dee91ef1549cb98c562d7cf81c799-1] regionserver.HStore(310): Store=333dee91ef1549cb98c562d7cf81c799/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,711 INFO [StoreOpener-41339753e8648ddea94256683ab37198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,712 DEBUG [StoreOpener-41339753e8648ddea94256683ab37198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf 2023-07-24 00:06:53,712 DEBUG [StoreOpener-41339753e8648ddea94256683ab37198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf 2023-07-24 00:06:53,713 INFO [StoreOpener-41339753e8648ddea94256683ab37198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41339753e8648ddea94256683ab37198 columnFamilyName cf 2023-07-24 00:06:53,716 INFO [StoreOpener-41339753e8648ddea94256683ab37198-1] regionserver.HStore(310): Store=41339753e8648ddea94256683ab37198/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:06:53,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:06:53,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:53,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 333dee91ef1549cb98c562d7cf81c799; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65385968, jitterRate=-0.02567315101623535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 333dee91ef1549cb98c562d7cf81c799: 2023-07-24 00:06:53,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799., pid=45, masterSystemTime=1690157213693 2023-07-24 00:06:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,724 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=333dee91ef1549cb98c562d7cf81c799, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:53,724 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157213724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157213724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157213724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157213724"}]},"ts":"1690157213724"} 2023-07-24 00:06:53,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41339753e8648ddea94256683ab37198 2023-07-24 00:06:53,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 00:06:53,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 333dee91ef1549cb98c562d7cf81c799, server=jenkins-hbase4.apache.org,32955,1690157167636 in 186 msec 2023-07-24 00:06:53,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:06:53,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41339753e8648ddea94256683ab37198; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62463372, jitterRate=-0.06922322511672974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:06:53,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41339753e8648ddea94256683ab37198: 2023-07-24 00:06:53,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198., pid=46, masterSystemTime=1690157213694 2023-07-24 00:06:53,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, ASSIGN in 351 msec 2023-07-24 00:06:53,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:53,745 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=41339753e8648ddea94256683ab37198, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:53,745 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157213745"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157213745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157213745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157213745"}]},"ts":"1690157213745"} 2023-07-24 00:06:53,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 00:06:53,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 41339753e8648ddea94256683ab37198, server=jenkins-hbase4.apache.org,41155,1690157167693 in 206 msec 2023-07-24 00:06:53,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 00:06:53,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, ASSIGN in 368 msec 2023-07-24 00:06:53,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:06:53,753 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157213753"}]},"ts":"1690157213753"} 2023-07-24 00:06:53,754 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 00:06:53,757 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:06:53,757 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 00:06:53,759 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 00:06:53,761 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,761 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,761 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,761 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:06:53,762 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:53,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:53,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:53,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 00:06:53,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 502 msec 2023-07-24 00:06:53,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 00:06:53,871 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 00:06:53,871 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-24 00:06:53,872 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:53,881 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-24 00:06:53,881 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:53,881 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-24 00:06:53,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 00:06:53,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157213886 (current time:1690157213886). 2023-07-24 00:06:53,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:06:53,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x7e9bb243 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:53,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@789e4f39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:53,905 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e9bb243 to 127.0.0.1:56229 2023-07-24 00:06:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x3feb1196 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:53,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c41b582, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:53,923 DEBUG [hconnection-0x162cc6b4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:53,926 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:53,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3feb1196 to 127.0.0.1:56229 2023-07-24 00:06:53,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:53,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 00:06:53,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:06:53,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 00:06:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 00:06:53,937 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 00:06:53,938 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690157813938 2023-07-24 00:06:53,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 00:06:53,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 00:06:53,940 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:06:53,940 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:06:53,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 00:06:53,947 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 00:06:53,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-24 00:06:53,950 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 00:06:53,953 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690157813953 2023-07-24 00:06:53,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,991 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 00:06:53,991 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:53,993 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 00:06:53,993 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 00:06:53,993 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,993 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,998 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:53,998 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:53,998 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:53,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:53,998 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:53,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:53,998 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:53,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:53,998 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,999 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:53,999 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:06:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 00:06:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 00:06:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 00:06:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 00:06:54,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,000 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 00:06:54,000 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,004 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 00:06:54,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 00:06:54,004 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 00:06:54,004 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,004 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 00:06:54,005 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 00:06:54,005 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 00:06:54,005 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 00:06:54,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,005 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 00:06:54,006 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 00:06:54,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 00:06:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,010 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 00:06:54,010 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 00:06:54,010 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 00:06:54,011 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:54,013 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,013 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,014 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,014 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 00:06:54,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12609904[Count = 1] remaining members to acquire global barrier 2023-07-24 00:06:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 00:06:54,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12609904[Count = 0] remaining members to acquire global barrier 2023-07-24 00:06:54,020 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 00:06:54,020 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,021 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 00:06:54,022 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 00:06:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,022 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:06:54,022 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 00:06:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,022 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,022 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:54,022 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:54,022 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 00:06:54,022 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,022 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:06:54,023 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:54,023 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. started... 2023-07-24 00:06:54,026 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:54,026 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:54,026 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 00:06:54,036 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,029 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41339753e8648ddea94256683ab37198: 2023-07-24 00:06:54,037 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. started... 2023-07-24 00:06:54,036 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 00:06:54,039 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,040 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:54,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 00:06:54,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:54,043 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:06:54,046 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:54,046 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 333dee91ef1549cb98c562d7cf81c799: 2023-07-24 00:06:54,047 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:06:54,047 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,047 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:54,047 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:06:54,071 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. completed. 2023-07-24 00:06:54,072 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 00:06:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:06:54,074 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,074 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 00:06:54,074 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,074 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 00:06:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41155,1690157167693': 2023-07-24 00:06:54,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 00:06:54,087 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. completed. 2023-07-24 00:06:54,087 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:54,087 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:54,087 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:54,087 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,087 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 00:06:54,087 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:06:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 00:06:54,090 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 00:06:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:06:54,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 00:06:54,100 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 00:06:54,100 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:06:54,100 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:06:54,100 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,100 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:06:54,102 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,102 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,102 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,102 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,102 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,102 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,103 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,105 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,105 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,106 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,108 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,108 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,109 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,116 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,118 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,118 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,118 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,118 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,118 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,116 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,118 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 00:06:54,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,213 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 00:06:54,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690157213938Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690157214116 (+178 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690157214118 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690157214128 (+10 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690157214162 (+34 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690157214212 (+50 ms) 2023-07-24 00:06:54,216 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 00:06:54,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 277 msec 2023-07-24 00:06:54,243 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:54,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 00:06:54,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:06:54,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:06:54,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:06:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 00:06:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:54,259 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:06:54,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 00:06:54,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157214276 (current time:1690157214276). 2023-07-24 00:06:54,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:06:54,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x62b96fb1 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:54,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f81f9d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:54,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:54,295 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:54,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62b96fb1 to 127.0.0.1:56229 2023-07-24 00:06:54,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:54,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x64e3cf62 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:06:54,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d8ef0a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:06:54,408 DEBUG [hconnection-0x1d11d7ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:06:54,412 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:06:54,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64e3cf62 to 127.0.0.1:56229 2023-07-24 00:06:54,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:06:54,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 00:06:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:06:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 00:06:54,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 00:06:54,425 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 00:06:54,426 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690157814426 2023-07-24 00:06:54,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 00:06:54,427 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 00:06:54,428 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:06:54,428 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:06:54,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 00:06:54,430 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 00:06:54,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-24 00:06:54,433 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 00:06:54,434 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690157814434 2023-07-24 00:06:54,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 00:06:54,474 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 00:06:54,474 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,476 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 00:06:54,476 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 00:06:54,476 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,476 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,478 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,478 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,478 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,478 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 00:06:54,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 00:06:54,480 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 00:06:54,480 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 00:06:54,483 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 00:06:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 00:06:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 00:06:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 00:06:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,484 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 00:06:54,485 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 00:06:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 00:06:54,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,486 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,486 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:06:54,486 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,489 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,489 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,489 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 00:06:54,489 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 00:06:54,489 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 00:06:54,489 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:06:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,494 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 00:06:54,494 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 00:06:54,494 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 00:06:54,494 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,494 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,497 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,497 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,498 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,498 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:06:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 00:06:54,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dda1783[Count = 1] remaining members to acquire global barrier 2023-07-24 00:06:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 00:06:54,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dda1783[Count = 0] remaining members to acquire global barrier 2023-07-24 00:06:54,501 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 00:06:54,502 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 00:06:54,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 00:06:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 00:06:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 00:06:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:06:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:54,503 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:54,504 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. started... 2023-07-24 00:06:54,504 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41339753e8648ddea94256683ab37198 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 00:06:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:06:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:06:54,504 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:54,504 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. started... 2023-07-24 00:06:54,504 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 333dee91ef1549cb98c562d7cf81c799 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 00:06:54,505 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,506 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,506 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:06:54,510 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 00:06:54,510 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,510 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 00:06:54,529 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:54,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 00:06:54,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:06:54,530 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:06:54,543 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/.tmp/cf/5254b23faac4465882de007405ed24a8 2023-07-24 00:06:54,543 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/.tmp/cf/a22ccec1d1db456f99e58c2650c2d87a 2023-07-24 00:06:54,551 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/.tmp/cf/a22ccec1d1db456f99e58c2650c2d87a as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf/a22ccec1d1db456f99e58c2650c2d87a 2023-07-24 00:06:54,551 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/.tmp/cf/5254b23faac4465882de007405ed24a8 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf/5254b23faac4465882de007405ed24a8 2023-07-24 00:06:54,558 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf/a22ccec1d1db456f99e58c2650c2d87a, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 00:06:54,558 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf/5254b23faac4465882de007405ed24a8, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 00:06:54,559 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 333dee91ef1549cb98c562d7cf81c799 in 55ms, sequenceid=6, compaction requested=false 2023-07-24 00:06:54,559 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 00:06:54,560 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 333dee91ef1549cb98c562d7cf81c799: 2023-07-24 00:06:54,560 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 00:06:54,560 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:54,560 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf/5254b23faac4465882de007405ed24a8] hfiles 2023-07-24 00:06:54,560 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf/5254b23faac4465882de007405ed24a8 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 00:06:54,561 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 41339753e8648ddea94256683ab37198 in 57ms, sequenceid=6, compaction requested=false 2023-07-24 00:06:54,563 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41339753e8648ddea94256683ab37198: 2023-07-24 00:06:54,563 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 00:06:54,563 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:06:54,563 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf/a22ccec1d1db456f99e58c2650c2d87a] hfiles 2023-07-24 00:06:54,563 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf/a22ccec1d1db456f99e58c2650c2d87a for snapshot=snaptb0-testConsecutiveExports 2023-07-24 00:06:54,579 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. completed. 2023-07-24 00:06:54,579 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:06:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 00:06:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:06:54,581 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,581 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 00:06:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,581 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,581 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 00:06:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41155,1690157167693': 2023-07-24 00:06:54,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 00:06:54,594 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. completed. 2023-07-24 00:06:54,594 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:06:54,594 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:06:54,594 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:06:54,594 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,594 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 00:06:54,594 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:06:54,597 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 00:06:54,597 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,597 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,597 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 00:06:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:06:54,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 00:06:54,602 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 00:06:54,602 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:06:54,602 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:06:54,602 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 00:06:54,602 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,604 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,605 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:06:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,606 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:06:54,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,606 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:06:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,608 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,609 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:06:54,609 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 00:06:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,615 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,615 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,615 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:06:54,616 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,615 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,616 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:06:54,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 00:06:54,616 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 00:06:54,618 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,616 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:06:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:06:54,616 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:06:54,618 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:06:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:06:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:06:54,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 00:06:54,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,678 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690157214427Consolidate snapshot: snaptb0-testConsecutiveExports at 1690157214618 (+191 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690157214618Writing data manifest for snaptb0-testConsecutiveExports at 1690157214624 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690157214644 (+20 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690157214678 (+34 ms) 2023-07-24 00:06:54,681 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 00:06:54,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 253 msec 2023-07-24 00:06:54,730 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:06:54,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 00:06:54,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:06:54,732 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732 2023-07-24 00:06:54,733 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:54,760 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:06:54,760 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@20f7aa39, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,760 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 00:06:54,768 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:06:54,783 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:54,784 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:54,785 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:54,785 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,775 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-5809917832012444622.jar 2023-07-24 00:06:55,776 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,776 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,842 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-4903567804544587057.jar 2023-07-24 00:06:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,845 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:06:55,845 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:06:55,845 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:06:55,846 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:06:55,846 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:06:55,846 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:06:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:06:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:06:55,848 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:06:55,848 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:06:55,849 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:06:55,849 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:55,849 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:55,850 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:55,850 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:55,851 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:06:55,851 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:55,852 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:06:56,237 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:06:56,239 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 00:06:56,241 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 00:06:57,596 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:06:57,596 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:06:57,599 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0002_000001 (auth:SIMPLE) 2023-07-24 00:06:58,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0003_000001 (auth:SIMPLE) 2023-07-24 00:06:58,576 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:07:02,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0003_000001 (auth:SIMPLE) 2023-07-24 00:07:04,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0003_000001 (auth:SIMPLE) 2023-07-24 00:07:08,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0003_000001 (auth:SIMPLE) 2023-07-24 00:07:09,440 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:07:09,440 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:07:09,444 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 00:07:09,444 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:07:09,445 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:07:09,445 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 00:07:09,448 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 00:07:09,448 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 00:07:09,448 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@22523188 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 00:07:09,449 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 00:07:09,449 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 00:07:09,450 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:07:09,487 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:07:09,487 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@620b558c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:07:09,487 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 00:07:09,497 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 00:07:09,514 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:09,514 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:09,515 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:09,515 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,492 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-333255154058725407.jar 2023-07-24 00:07:10,493 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,493 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,569 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-4779040084835314356.jar 2023-07-24 00:07:10,569 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,570 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,570 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,571 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,571 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,571 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:07:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:07:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:07:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:07:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:07:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:07:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:07:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:07:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:07:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:07:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:11,087 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:07:11,090 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 00:07:11,092 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 00:07:14,188 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:07:14,188 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:07:14,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0003_000001 (auth:SIMPLE) 2023-07-24 00:07:15,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0004_000001 (auth:SIMPLE) 2023-07-24 00:07:18,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0004_000001 (auth:SIMPLE) 2023-07-24 00:07:21,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0004_000001 (auth:SIMPLE) 2023-07-24 00:07:24,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0004_000001 (auth:SIMPLE) 2023-07-24 00:07:25,362 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:07:25,363 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:07:25,366 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 00:07:25,367 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:07:25,367 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:07:25,367 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 00:07:25,372 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 00:07:25,372 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 00:07:25,372 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@22523188 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 00:07:25,373 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 00:07:25,373 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/local-export-1690157214732/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 00:07:25,387 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 00:07:25,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 00:07:25,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 00:07:25,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157245393"}]},"ts":"1690157245393"} 2023-07-24 00:07:25,395 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 00:07:25,398 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 00:07:25,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, UNASSIGN}] 2023-07-24 00:07:25,400 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, UNASSIGN 2023-07-24 00:07:25,403 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, UNASSIGN 2023-07-24 00:07:25,404 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=333dee91ef1549cb98c562d7cf81c799, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:25,405 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157245404"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157245404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157245404"}]},"ts":"1690157245404"} 2023-07-24 00:07:25,405 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=41339753e8648ddea94256683ab37198, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:25,405 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157245405"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157245405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157245405"}]},"ts":"1690157245405"} 2023-07-24 00:07:25,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 333dee91ef1549cb98c562d7cf81c799, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:07:25,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 41339753e8648ddea94256683ab37198, server=jenkins-hbase4.apache.org,41155,1690157167693}] 2023-07-24 00:07:25,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 00:07:25,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:07:25,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 333dee91ef1549cb98c562d7cf81c799, disabling compactions & flushes 2023-07-24 00:07:25,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:07:25,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:07:25,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. after waiting 0 ms 2023-07-24 00:07:25,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:07:25,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 41339753e8648ddea94256683ab37198 2023-07-24 00:07:25,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41339753e8648ddea94256683ab37198, disabling compactions & flushes 2023-07-24 00:07:25,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:07:25,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:07:25,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. after waiting 0 ms 2023-07-24 00:07:25,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:07:25,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:07:25,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:25,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799. 2023-07-24 00:07:25,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 333dee91ef1549cb98c562d7cf81c799: 2023-07-24 00:07:25,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:07:25,596 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=333dee91ef1549cb98c562d7cf81c799, regionState=CLOSED 2023-07-24 00:07:25,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157245596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157245596"}]},"ts":"1690157245596"} 2023-07-24 00:07:25,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:07:25,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:25,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198. 2023-07-24 00:07:25,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41339753e8648ddea94256683ab37198: 2023-07-24 00:07:25,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-24 00:07:25,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 333dee91ef1549cb98c562d7cf81c799, server=jenkins-hbase4.apache.org,32955,1690157167636 in 189 msec 2023-07-24 00:07:25,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 41339753e8648ddea94256683ab37198 2023-07-24 00:07:25,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=41339753e8648ddea94256683ab37198, regionState=CLOSED 2023-07-24 00:07:25,606 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690157245606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157245606"}]},"ts":"1690157245606"} 2023-07-24 00:07:25,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=333dee91ef1549cb98c562d7cf81c799, UNASSIGN in 206 msec 2023-07-24 00:07:25,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-24 00:07:25,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 41339753e8648ddea94256683ab37198, server=jenkins-hbase4.apache.org,41155,1690157167693 in 199 msec 2023-07-24 00:07:25,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-24 00:07:25,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41339753e8648ddea94256683ab37198, UNASSIGN in 216 msec 2023-07-24 00:07:25,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157245618"}]},"ts":"1690157245618"} 2023-07-24 00:07:25,620 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 00:07:25,622 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 00:07:25,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 236 msec 2023-07-24 00:07:25,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 00:07:25,696 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 00:07:25,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 00:07:25,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,703 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 00:07:25,705 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,708 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 00:07:25,720 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,720 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,720 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,720 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 00:07:25,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 00:07:25,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 00:07:25,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 00:07:25,725 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,725 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,726 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,726 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 00:07:25,726 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:25,726 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:25,726 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:25,726 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:25,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 00:07:25,739 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 2023-07-24 00:07:25,744 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/recovered.edits] 2023-07-24 00:07:25,748 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:07:25,755 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/recovered.edits] 2023-07-24 00:07:25,760 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf/a22ccec1d1db456f99e58c2650c2d87a to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/cf/a22ccec1d1db456f99e58c2650c2d87a 2023-07-24 00:07:25,767 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf/5254b23faac4465882de007405ed24a8 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/cf/5254b23faac4465882de007405ed24a8 2023-07-24 00:07:25,769 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198/recovered.edits/9.seqid 2023-07-24 00:07:25,770 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/41339753e8648ddea94256683ab37198 2023-07-24 00:07:25,772 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799/recovered.edits/9.seqid 2023-07-24 00:07:25,773 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testConsecutiveExports/333dee91ef1549cb98c562d7cf81c799 2023-07-24 00:07:25,773 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 00:07:25,782 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,788 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 00:07:25,798 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 00:07:25,804 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,804 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 00:07:25,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157245804"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:25,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157245804"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:25,808 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 00:07:25,809 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 41339753e8648ddea94256683ab37198, NAME => 'testtb-testConsecutiveExports,,1690157213260.41339753e8648ddea94256683ab37198.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 333dee91ef1549cb98c562d7cf81c799, NAME => 'testtb-testConsecutiveExports,1,1690157213260.333dee91ef1549cb98c562d7cf81c799.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 00:07:25,809 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 00:07:25,809 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157245809"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:25,825 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 00:07:25,828 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 00:07:25,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 00:07:25,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 131 msec 2023-07-24 00:07:26,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 00:07:26,034 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 00:07:26,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 00:07:26,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 00:07:26,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 00:07:26,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 00:07:26,103 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 768), OpenFileDescriptor=895 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=385 (was 376) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=5841 (was 5594) - AvailableMemoryMB LEAK? - 2023-07-24 00:07:26,104 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-24 00:07:26,128 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=184, AvailableMemoryMB=5835 2023-07-24 00:07:26,128 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-24 00:07:26,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:07:26,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:26,134 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:07:26,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 00:07:26,136 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:07:26,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 00:07:26,141 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:26,141 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:26,142 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 empty. 2023-07-24 00:07:26,142 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 empty. 2023-07-24 00:07:26,142 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:26,142 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:26,142 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 00:07:26,162 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 00:07:26,164 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45733e216aa4a243be4ee9a9a0a13ac7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:07:26,164 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c24802ae52434f9fd508bfd351141159, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:07:26,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 00:07:26,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:26,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c24802ae52434f9fd508bfd351141159, disabling compactions & flushes 2023-07-24 00:07:26,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:26,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:26,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. after waiting 0 ms 2023-07-24 00:07:26,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:26,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:26,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c24802ae52434f9fd508bfd351141159: 2023-07-24 00:07:26,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 00:07:26,636 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:26,637 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 45733e216aa4a243be4ee9a9a0a13ac7, disabling compactions & flushes 2023-07-24 00:07:26,637 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:26,637 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:26,637 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. after waiting 0 ms 2023-07-24 00:07:26,637 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:26,637 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:26,637 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 45733e216aa4a243be4ee9a9a0a13ac7: 2023-07-24 00:07:26,641 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:07:26,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157246642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157246642"}]},"ts":"1690157246642"} 2023-07-24 00:07:26,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157246642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157246642"}]},"ts":"1690157246642"} 2023-07-24 00:07:26,657 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:07:26,658 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:07:26,659 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157246658"}]},"ts":"1690157246658"} 2023-07-24 00:07:26,660 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 00:07:26,664 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:07:26,665 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:07:26,665 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:07:26,666 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:07:26,666 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:07:26,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, ASSIGN}] 2023-07-24 00:07:26,672 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, ASSIGN 2023-07-24 00:07:26,673 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, ASSIGN 2023-07-24 00:07:26,674 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41155,1690157167693; forceNewPlan=false, retain=false 2023-07-24 00:07:26,674 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:07:26,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 00:07:26,824 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:07:26,827 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c24802ae52434f9fd508bfd351141159, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:26,827 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=45733e216aa4a243be4ee9a9a0a13ac7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:26,828 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157246827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157246827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157246827"}]},"ts":"1690157246827"} 2023-07-24 00:07:26,828 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157246827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157246827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157246827"}]},"ts":"1690157246827"} 2023-07-24 00:07:26,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure c24802ae52434f9fd508bfd351141159, server=jenkins-hbase4.apache.org,41155,1690157167693}] 2023-07-24 00:07:26,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 45733e216aa4a243be4ee9a9a0a13ac7, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:07:26,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:26,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c24802ae52434f9fd508bfd351141159, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 00:07:26,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. service=AccessControlService 2023-07-24 00:07:26,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:26,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:26,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:26,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:26,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:26,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:26,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45733e216aa4a243be4ee9a9a0a13ac7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 00:07:26,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. service=AccessControlService 2023-07-24 00:07:26,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:26,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:26,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:26,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:26,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:27,005 INFO [StoreOpener-c24802ae52434f9fd508bfd351141159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:27,011 INFO [StoreOpener-45733e216aa4a243be4ee9a9a0a13ac7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:27,015 DEBUG [StoreOpener-c24802ae52434f9fd508bfd351141159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf 2023-07-24 00:07:27,015 DEBUG [StoreOpener-c24802ae52434f9fd508bfd351141159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf 2023-07-24 00:07:27,017 INFO [StoreOpener-c24802ae52434f9fd508bfd351141159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c24802ae52434f9fd508bfd351141159 columnFamilyName cf 2023-07-24 00:07:27,018 INFO [StoreOpener-c24802ae52434f9fd508bfd351141159-1] regionserver.HStore(310): Store=c24802ae52434f9fd508bfd351141159/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:27,019 DEBUG [StoreOpener-45733e216aa4a243be4ee9a9a0a13ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf 2023-07-24 00:07:27,019 DEBUG [StoreOpener-45733e216aa4a243be4ee9a9a0a13ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf 2023-07-24 00:07:27,019 INFO [StoreOpener-45733e216aa4a243be4ee9a9a0a13ac7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45733e216aa4a243be4ee9a9a0a13ac7 columnFamilyName cf 2023-07-24 00:07:27,020 INFO [StoreOpener-45733e216aa4a243be4ee9a9a0a13ac7-1] regionserver.HStore(310): Store=45733e216aa4a243be4ee9a9a0a13ac7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:27,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:27,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:27,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:27,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:27,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:27,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:27,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:07:27,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 45733e216aa4a243be4ee9a9a0a13ac7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63755918, jitterRate=-0.049962788820266724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:27,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 45733e216aa4a243be4ee9a9a0a13ac7: 2023-07-24 00:07:27,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7., pid=61, masterSystemTime=1690157246986 2023-07-24 00:07:27,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:07:27,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c24802ae52434f9fd508bfd351141159; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69590299, jitterRate=0.03697626292705536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:27,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:27,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c24802ae52434f9fd508bfd351141159: 2023-07-24 00:07:27,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=45733e216aa4a243be4ee9a9a0a13ac7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:27,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157247036"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157247036"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157247036"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157247036"}]},"ts":"1690157247036"} 2023-07-24 00:07:27,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159., pid=60, masterSystemTime=1690157246985 2023-07-24 00:07:27,041 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c24802ae52434f9fd508bfd351141159, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,041 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157247041"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157247041"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157247041"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157247041"}]},"ts":"1690157247041"} 2023-07-24 00:07:27,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-24 00:07:27,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 45733e216aa4a243be4ee9a9a0a13ac7, server=jenkins-hbase4.apache.org,32955,1690157167636 in 206 msec 2023-07-24 00:07:27,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:27,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:27,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, ASSIGN in 378 msec 2023-07-24 00:07:27,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-24 00:07:27,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure c24802ae52434f9fd508bfd351141159, server=jenkins-hbase4.apache.org,41155,1690157167693 in 212 msec 2023-07-24 00:07:27,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 00:07:27,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, ASSIGN in 382 msec 2023-07-24 00:07:27,056 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:07:27,056 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157247056"}]},"ts":"1690157247056"} 2023-07-24 00:07:27,058 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 00:07:27,082 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:07:27,083 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 00:07:27,086 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 00:07:27,088 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:27,088 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:27,088 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:27,088 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:27,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:27,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:27,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:27,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:27,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 961 msec 2023-07-24 00:07:27,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 00:07:27,245 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 00:07:27,246 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-24 00:07:27,246 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:07:27,255 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-24 00:07:27,255 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:07:27,255 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-24 00:07:27,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 00:07:27,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157247268 (current time:1690157247268). 2023-07-24 00:07:27,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:07:27,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x0c0e4751 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:27,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2849d90b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:27,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:27,291 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:27,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c0e4751 to 127.0.0.1:56229 2023-07-24 00:07:27,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:27,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x4af7b135 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:27,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34bd43f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:27,301 DEBUG [hconnection-0x52da45e8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:27,302 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af7b135 to 127.0.0.1:56229 2023-07-24 00:07:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 00:07:27,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:07:27,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 00:07:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 00:07:27,314 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 00:07:27,315 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690157847315 2023-07-24 00:07:27,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 00:07:27,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,317 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:07:27,317 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:07:27,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 00:07:27,318 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 00:07:27,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-24 00:07:27,320 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 00:07:27,321 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690157847321 2023-07-24 00:07:27,417 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:27,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:27,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:27,422 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:07:27,622 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:27,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:27,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:27,624 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 00:07:27,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,784 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 00:07:27,784 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:27,784 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 00:07:27,784 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 00:07:27,785 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,785 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,787 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:27,787 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:27,787 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:27,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:27,787 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:27,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:27,788 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,788 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,788 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,788 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:07:27,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 00:07:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 00:07:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 00:07:27,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 00:07:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 00:07:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 00:07:27,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,799 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 00:07:27,799 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:27,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 00:07:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:27,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,810 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 00:07:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 00:07:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 00:07:27,818 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 00:07:27,818 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 00:07:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 00:07:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 00:07:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 00:07:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 00:07:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 00:07:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,822 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:27,825 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:27,825 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,825 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:27,825 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,826 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:27,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:27,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 00:07:27,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bd5af69[Count = 1] remaining members to acquire global barrier 2023-07-24 00:07:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:27,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 00:07:27,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bd5af69[Count = 0] remaining members to acquire global barrier 2023-07-24 00:07:27,839 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 00:07:27,839 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,840 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 00:07:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 00:07:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:07:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 00:07:27,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 00:07:27,842 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:27,843 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:27,843 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:07:27,850 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:27,851 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:27,851 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:27,851 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 00:07:27,851 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:27,851 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 00:07:27,855 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. started... 2023-07-24 00:07:27,868 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:27,871 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:27,870 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c24802ae52434f9fd508bfd351141159: 2023-07-24 00:07:27,870 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:27,871 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. started... 2023-07-24 00:07:27,875 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45733e216aa4a243be4ee9a9a0a13ac7: 2023-07-24 00:07:27,875 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,875 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:27,875 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:27,876 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:27,876 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:07:27,876 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:07:27,927 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:27,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:27,938 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 00:07:28,383 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. completed. 2023-07-24 00:07:28,383 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:28,384 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:28,384 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:28,384 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,384 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 00:07:28,384 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:07:28,386 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 00:07:28,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:28,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 00:07:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:07:28,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 00:07:28,399 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. completed. 2023-07-24 00:07:28,399 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 00:07:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:07:28,402 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 00:07:28,402 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:28,402 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 00:07:28,402 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41155,1690157167693': 2023-07-24 00:07:28,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 00:07:28,416 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 00:07:28,416 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:07:28,416 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:07:28,416 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,416 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:07:28,419 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,419 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:28,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,419 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,419 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:28,419 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,419 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:28,420 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,420 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:28,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:28,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:28,421 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:28,422 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,425 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,425 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:28,426 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,430 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,430 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:28,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:28,431 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:28,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:28,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:28,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,431 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:28,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:28,433 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:28,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:28,433 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:28,434 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:28,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:28,434 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,434 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:28,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,438 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:28,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:28,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:28,440 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 00:07:28,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 00:07:28,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,572 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:28,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690157247315Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690157248433 (+1118 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690157248433Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690157248463 (+30 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690157248503 (+40 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690157248571 (+68 ms) 2023-07-24 00:07:28,575 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 00:07:28,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2580 sec 2023-07-24 00:07:28,677 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 00:07:29,440 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:29,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:29,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:07:29,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:07:29,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:07:29,468 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,468 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:29,468 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:07:29,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 00:07:29,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157249502 (current time:1690157249502). 2023-07-24 00:07:29,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:07:29,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x7a65bf50 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:29,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f9c430, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:29,543 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:29,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a65bf50 to 127.0.0.1:56229 2023-07-24 00:07:29,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:29,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x2589af9c to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:29,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3653ac1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:29,591 DEBUG [hconnection-0x245fdd40-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:29,598 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:29,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2589af9c to 127.0.0.1:56229 2023-07-24 00:07:29,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:29,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 00:07:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:07:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 00:07:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 00:07:29,625 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 00:07:29,627 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690157849627 2023-07-24 00:07:29,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 00:07:29,629 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:07:29,629 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:07:29,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 00:07:29,631 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 00:07:29,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 20 msec 2023-07-24 00:07:29,634 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 00:07:29,637 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690157849637 2023-07-24 00:07:29,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,655 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 00:07:29,655 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:29,657 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 00:07:29,657 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 00:07:29,657 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,658 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,674 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,674 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:29,674 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:29,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:29,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:29,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:29,674 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:29,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:29,674 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:29,674 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,675 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,675 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:07:29,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 00:07:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 00:07:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 00:07:29,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 00:07:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 00:07:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 00:07:29,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 00:07:29,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 00:07:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 00:07:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 00:07:29,682 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 00:07:29,682 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 00:07:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 00:07:29,683 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 00:07:29,683 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 00:07:29,684 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 00:07:29,684 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 00:07:29,684 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 00:07:29,701 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:29,728 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:29,728 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,729 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,729 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:29,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:29,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,731 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:07:29,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@517a3e55[Count = 1] remaining members to acquire global barrier 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:29,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:29,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 00:07:29,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@517a3e55[Count = 0] remaining members to acquire global barrier 2023-07-24 00:07:29,735 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 00:07:29,735 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 00:07:29,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 00:07:29,753 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,753 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:29,753 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 00:07:29,753 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:29,753 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. started... 2023-07-24 00:07:29,753 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. started... 2023-07-24 00:07:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:07:29,754 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45733e216aa4a243be4ee9a9a0a13ac7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 00:07:29,754 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c24802ae52434f9fd508bfd351141159 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 00:07:29,777 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 00:07:29,777 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:29,777 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 00:07:29,780 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/.tmp/cf/afa579675b5e4213a70f228d77a2f180 2023-07-24 00:07:29,781 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/.tmp/cf/eaa9b78d3057481e940388e702781070 2023-07-24 00:07:29,787 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/.tmp/cf/afa579675b5e4213a70f228d77a2f180 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf/afa579675b5e4213a70f228d77a2f180 2023-07-24 00:07:29,794 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/.tmp/cf/eaa9b78d3057481e940388e702781070 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf/eaa9b78d3057481e940388e702781070 2023-07-24 00:07:29,811 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf/eaa9b78d3057481e940388e702781070, entries=46, sequenceid=6, filesize=7.9 K 2023-07-24 00:07:29,812 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf/afa579675b5e4213a70f228d77a2f180, entries=4, sequenceid=6, filesize=5.1 K 2023-07-24 00:07:29,814 INFO [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c24802ae52434f9fd508bfd351141159 in 60ms, sequenceid=6, compaction requested=false 2023-07-24 00:07:29,816 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c24802ae52434f9fd508bfd351141159: 2023-07-24 00:07:29,816 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,816 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:29,816 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf/eaa9b78d3057481e940388e702781070] hfiles 2023-07-24 00:07:29,816 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf/eaa9b78d3057481e940388e702781070 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,816 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 45733e216aa4a243be4ee9a9a0a13ac7 in 62ms, sequenceid=6, compaction requested=false 2023-07-24 00:07:29,816 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45733e216aa4a243be4ee9a9a0a13ac7: 2023-07-24 00:07:29,817 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,817 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:29,817 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf/afa579675b5e4213a70f228d77a2f180] hfiles 2023-07-24 00:07:29,817 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf/afa579675b5e4213a70f228d77a2f180 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,896 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. completed. 2023-07-24 00:07:29,897 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:29,897 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:29,897 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:29,897 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,897 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 00:07:29,897 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:07:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 00:07:29,921 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:29,922 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 00:07:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,927 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. completed. 2023-07-24 00:07:29,927 DEBUG [rs(jenkins-hbase4.apache.org,41155,1690157167693)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 00:07:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:07:29,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:29,931 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:29,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:29,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:29,933 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 00:07:29,943 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 00:07:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,943 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,943 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:29,943 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 00:07:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:07:29,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 00:07:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:29,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41155,1690157167693': 2023-07-24 00:07:29,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 00:07:29,951 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 00:07:29,951 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:07:29,951 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:07:29,951 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,951 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:07:29,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:29,985 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:29,985 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:29,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,986 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:29,987 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:29,988 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:29,989 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:29,989 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:30,005 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:30,006 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:30,006 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:30,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,005 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:30,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,005 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:30,006 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:30,006 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:30,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:30,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:30,006 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:30,006 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:30,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:30,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:30,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,009 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:30,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:30,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:30,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 00:07:30,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,097 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:30,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690157249627Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690157250006 (+379 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690157250006Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690157250012 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690157250035 (+23 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690157250096 (+61 ms) 2023-07-24 00:07:30,099 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 00:07:30,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 470 msec 2023-07-24 00:07:30,233 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 00:07:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:07:30,268 DEBUG [Listener at jenkins-hbase4.apache.org/43137] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 00:07:30,274 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 00:07:30,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 00:07:30,276 DEBUG [Listener at jenkins-hbase4.apache.org/43137] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 00:07:30,282 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 00:07:30,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34461] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 00:07:30,283 DEBUG [Listener at jenkins-hbase4.apache.org/43137] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 00:07:30,287 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 00:07:30,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 00:07:30,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:07:30,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:30,293 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:07:30,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 00:07:30,294 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:07:30,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 00:07:30,298 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,303 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 empty. 2023-07-24 00:07:30,303 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,303 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,303 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a empty. 2023-07-24 00:07:30,304 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,304 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 00:07:30,328 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 00:07:30,329 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2a7e58d1928887663cdc9fa0a7cecc61, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:07:30,329 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8583f6eeb5abf99cbc0a04ca229bb63a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:07:30,351 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:30,351 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8583f6eeb5abf99cbc0a04ca229bb63a, disabling compactions & flushes 2023-07-24 00:07:30,351 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. after waiting 0 ms 2023-07-24 00:07:30,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,352 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8583f6eeb5abf99cbc0a04ca229bb63a: 2023-07-24 00:07:30,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:30,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 2a7e58d1928887663cdc9fa0a7cecc61, disabling compactions & flushes 2023-07-24 00:07:30,362 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. after waiting 0 ms 2023-07-24 00:07:30,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,362 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 2a7e58d1928887663cdc9fa0a7cecc61: 2023-07-24 00:07:30,365 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:07:30,367 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157250366"}]},"ts":"1690157250366"} 2023-07-24 00:07:30,367 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157250366"}]},"ts":"1690157250366"} 2023-07-24 00:07:30,369 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:07:30,370 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:07:30,370 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157250370"}]},"ts":"1690157250370"} 2023-07-24 00:07:30,372 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 00:07:30,375 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:07:30,377 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:07:30,377 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:07:30,377 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:07:30,377 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:07:30,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, ASSIGN}] 2023-07-24 00:07:30,381 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, ASSIGN 2023-07-24 00:07:30,381 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, ASSIGN 2023-07-24 00:07:30,382 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34461,1690157167575; forceNewPlan=false, retain=false 2023-07-24 00:07:30,383 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:07:30,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 00:07:30,448 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0004_000001 (auth:SIMPLE) 2023-07-24 00:07:30,533 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:07:30,536 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8583f6eeb5abf99cbc0a04ca229bb63a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:30,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2a7e58d1928887663cdc9fa0a7cecc61, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:30,536 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157250535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157250535"}]},"ts":"1690157250535"} 2023-07-24 00:07:30,536 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157250535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157250535"}]},"ts":"1690157250535"} 2023-07-24 00:07:30,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 8583f6eeb5abf99cbc0a04ca229bb63a, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:07:30,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 2a7e58d1928887663cdc9fa0a7cecc61, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:07:30,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 00:07:30,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8583f6eeb5abf99cbc0a04ca229bb63a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 00:07:30,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a7e58d1928887663cdc9fa0a7cecc61, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. service=AccessControlService 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. service=AccessControlService 2023-07-24 00:07:30,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:30,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,708 INFO [StoreOpener-2a7e58d1928887663cdc9fa0a7cecc61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,708 INFO [StoreOpener-8583f6eeb5abf99cbc0a04ca229bb63a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,709 DEBUG [StoreOpener-2a7e58d1928887663cdc9fa0a7cecc61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf 2023-07-24 00:07:30,709 DEBUG [StoreOpener-2a7e58d1928887663cdc9fa0a7cecc61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf 2023-07-24 00:07:30,709 DEBUG [StoreOpener-8583f6eeb5abf99cbc0a04ca229bb63a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf 2023-07-24 00:07:30,709 DEBUG [StoreOpener-8583f6eeb5abf99cbc0a04ca229bb63a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf 2023-07-24 00:07:30,710 INFO [StoreOpener-2a7e58d1928887663cdc9fa0a7cecc61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a7e58d1928887663cdc9fa0a7cecc61 columnFamilyName cf 2023-07-24 00:07:30,710 INFO [StoreOpener-8583f6eeb5abf99cbc0a04ca229bb63a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8583f6eeb5abf99cbc0a04ca229bb63a columnFamilyName cf 2023-07-24 00:07:30,710 INFO [StoreOpener-2a7e58d1928887663cdc9fa0a7cecc61-1] regionserver.HStore(310): Store=2a7e58d1928887663cdc9fa0a7cecc61/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:30,710 INFO [StoreOpener-8583f6eeb5abf99cbc0a04ca229bb63a-1] regionserver.HStore(310): Store=8583f6eeb5abf99cbc0a04ca229bb63a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:30,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:30,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:07:30,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:07:30,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8583f6eeb5abf99cbc0a04ca229bb63a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68587378, jitterRate=0.022031575441360474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:30,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8583f6eeb5abf99cbc0a04ca229bb63a: 2023-07-24 00:07:30,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a7e58d1928887663cdc9fa0a7cecc61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60295937, jitterRate=-0.10152052342891693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:30,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a7e58d1928887663cdc9fa0a7cecc61: 2023-07-24 00:07:30,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a., pid=69, masterSystemTime=1690157250699 2023-07-24 00:07:30,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61., pid=70, masterSystemTime=1690157250699 2023-07-24 00:07:30,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:30,721 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8583f6eeb5abf99cbc0a04ca229bb63a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,721 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157250721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157250721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157250721"}]},"ts":"1690157250721"} 2023-07-24 00:07:30,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:30,721 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2a7e58d1928887663cdc9fa0a7cecc61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:30,722 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157250721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157250721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157250721"}]},"ts":"1690157250721"} 2023-07-24 00:07:30,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 00:07:30,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 8583f6eeb5abf99cbc0a04ca229bb63a, server=jenkins-hbase4.apache.org,32955,1690157167636 in 180 msec 2023-07-24 00:07:30,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, ASSIGN in 348 msec 2023-07-24 00:07:30,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 00:07:30,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 2a7e58d1928887663cdc9fa0a7cecc61, server=jenkins-hbase4.apache.org,34461,1690157167575 in 182 msec 2023-07-24 00:07:30,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 00:07:30,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, ASSIGN in 351 msec 2023-07-24 00:07:30,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:07:30,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157250731"}]},"ts":"1690157250731"} 2023-07-24 00:07:30,733 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 00:07:30,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:07:30,737 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 00:07:30,739 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 00:07:30,740 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:30,740 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:30,740 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:30,740 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:30,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 452 msec 2023-07-24 00:07:30,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:30,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 00:07:30,899 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 00:07:30,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 2a7e58d1928887663cdc9fa0a7cecc61, 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:30,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2a7e58d1928887663cdc9fa0a7cecc61, 8583f6eeb5abf99cbc0a04ca229bb63a], force=true 2023-07-24 00:07:30,937 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2a7e58d1928887663cdc9fa0a7cecc61, 8583f6eeb5abf99cbc0a04ca229bb63a], force=true 2023-07-24 00:07:30,937 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2a7e58d1928887663cdc9fa0a7cecc61, 8583f6eeb5abf99cbc0a04ca229bb63a], force=true 2023-07-24 00:07:30,937 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2a7e58d1928887663cdc9fa0a7cecc61, 8583f6eeb5abf99cbc0a04ca229bb63a], force=true 2023-07-24 00:07:30,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 00:07:30,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, UNASSIGN}] 2023-07-24 00:07:30,965 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, UNASSIGN 2023-07-24 00:07:30,965 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, UNASSIGN 2023-07-24 00:07:30,966 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2a7e58d1928887663cdc9fa0a7cecc61, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:30,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8583f6eeb5abf99cbc0a04ca229bb63a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:30,966 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157250966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157250966"}]},"ts":"1690157250966"} 2023-07-24 00:07:30,966 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157250966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157250966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157250966"}]},"ts":"1690157250966"} 2023-07-24 00:07:30,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 2a7e58d1928887663cdc9fa0a7cecc61, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:07:30,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 8583f6eeb5abf99cbc0a04ca229bb63a, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:07:31,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 00:07:31,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:31,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a7e58d1928887663cdc9fa0a7cecc61, disabling compactions & flushes 2023-07-24 00:07:31,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:31,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:31,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. after waiting 0 ms 2023-07-24 00:07:31,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:31,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2a7e58d1928887663cdc9fa0a7cecc61 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 00:07:31,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:31,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8583f6eeb5abf99cbc0a04ca229bb63a, disabling compactions & flushes 2023-07-24 00:07:31,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:31,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:31,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. after waiting 0 ms 2023-07-24 00:07:31,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:31,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8583f6eeb5abf99cbc0a04ca229bb63a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 00:07:31,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/.tmp/cf/86225f6e4fba42368729cdfea2343c78 2023-07-24 00:07:31,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/.tmp/cf/3cdcda6ae175434f987b860d14f50f41 2023-07-24 00:07:31,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/.tmp/cf/86225f6e4fba42368729cdfea2343c78 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf/86225f6e4fba42368729cdfea2343c78 2023-07-24 00:07:31,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/.tmp/cf/3cdcda6ae175434f987b860d14f50f41 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf/3cdcda6ae175434f987b860d14f50f41 2023-07-24 00:07:31,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf/3cdcda6ae175434f987b860d14f50f41, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 00:07:31,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf/86225f6e4fba42368729cdfea2343c78, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 00:07:31,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2a7e58d1928887663cdc9fa0a7cecc61 in 34ms, sequenceid=5, compaction requested=false 2023-07-24 00:07:31,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 00:07:31,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8583f6eeb5abf99cbc0a04ca229bb63a in 33ms, sequenceid=5, compaction requested=false 2023-07-24 00:07:31,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 00:07:31,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 00:07:31,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 00:07:31,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:31,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61. 2023-07-24 00:07:31,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:31,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a7e58d1928887663cdc9fa0a7cecc61: 2023-07-24 00:07:31,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a. 2023-07-24 00:07:31,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8583f6eeb5abf99cbc0a04ca229bb63a: 2023-07-24 00:07:31,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:31,169 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2a7e58d1928887663cdc9fa0a7cecc61, regionState=CLOSED 2023-07-24 00:07:31,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:31,169 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157251169"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157251169"}]},"ts":"1690157251169"} 2023-07-24 00:07:31,170 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8583f6eeb5abf99cbc0a04ca229bb63a, regionState=CLOSED 2023-07-24 00:07:31,170 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690157251170"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157251170"}]},"ts":"1690157251170"} 2023-07-24 00:07:31,174 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:07:31,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 00:07:31,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 00:07:31,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 2a7e58d1928887663cdc9fa0a7cecc61, server=jenkins-hbase4.apache.org,34461,1690157167575 in 203 msec 2023-07-24 00:07:31,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 8583f6eeb5abf99cbc0a04ca229bb63a, server=jenkins-hbase4.apache.org,32955,1690157167636 in 203 msec 2023-07-24 00:07:31,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8583f6eeb5abf99cbc0a04ca229bb63a, UNASSIGN in 212 msec 2023-07-24 00:07:31,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 00:07:31,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a7e58d1928887663cdc9fa0a7cecc61, UNASSIGN in 215 msec 2023-07-24 00:07:31,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 00:07:31,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 00:07:31,739 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 00:07:31,742 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250290.2a7e58d1928887663cdc9fa0a7cecc61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:31,742 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690157250290.8583f6eeb5abf99cbc0a04ca229bb63a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:31,743 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:31,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, ASSIGN}] 2023-07-24 00:07:31,821 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, ASSIGN 2023-07-24 00:07:31,822 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34461,1690157167575; forceNewPlan=false, retain=false 2023-07-24 00:07:31,972 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 00:07:31,975 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=493c5f7b756d8cb45c42e6e4a473706b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:31,983 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690157251975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157251975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157251975"}]},"ts":"1690157251975"} 2023-07-24 00:07:31,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 493c5f7b756d8cb45c42e6e4a473706b, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:07:32,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 00:07:32,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:32,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 493c5f7b756d8cb45c42e6e4a473706b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.', STARTKEY => '', ENDKEY => ''} 2023-07-24 00:07:32,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. service=AccessControlService 2023-07-24 00:07:32,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:32,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:32,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/.regioninfo 2023-07-24 00:07:32,252 INFO [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,257 DEBUG [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf 2023-07-24 00:07:32,257 DEBUG [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf 2023-07-24 00:07:32,258 INFO [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 493c5f7b756d8cb45c42e6e4a473706b columnFamilyName cf 2023-07-24 00:07:32,315 DEBUG [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] regionserver.HStore(539): loaded hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/3cdcda6ae175434f987b860d14f50f41.8583f6eeb5abf99cbc0a04ca229bb63a->hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf/3cdcda6ae175434f987b860d14f50f41-top 2023-07-24 00:07:32,326 DEBUG [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] regionserver.HStore(539): loaded hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/86225f6e4fba42368729cdfea2343c78.2a7e58d1928887663cdc9fa0a7cecc61->hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf/86225f6e4fba42368729cdfea2343c78-top 2023-07-24 00:07:32,327 INFO [StoreOpener-493c5f7b756d8cb45c42e6e4a473706b-1] regionserver.HStore(310): Store=493c5f7b756d8cb45c42e6e4a473706b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:32,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:32,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 493c5f7b756d8cb45c42e6e4a473706b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68610164, jitterRate=0.022371113300323486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:32,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 493c5f7b756d8cb45c42e6e4a473706b: 2023-07-24 00:07:32,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b., pid=77, masterSystemTime=1690157252137 2023-07-24 00:07:32,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.,because compaction is disabled. 2023-07-24 00:07:32,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:32,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:32,343 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=493c5f7b756d8cb45c42e6e4a473706b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:32,343 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690157252342"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157252342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157252342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157252342"}]},"ts":"1690157252342"} 2023-07-24 00:07:32,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 00:07:32,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 493c5f7b756d8cb45c42e6e4a473706b, server=jenkins-hbase4.apache.org,34461,1690157167575 in 360 msec 2023-07-24 00:07:32,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 00:07:32,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, ASSIGN in 531 msec 2023-07-24 00:07:32,362 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2a7e58d1928887663cdc9fa0a7cecc61, 8583f6eeb5abf99cbc0a04ca229bb63a], force=true in 1.4290 sec 2023-07-24 00:07:33,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 00:07:33,047 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 00:07:33,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 00:07:33,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157253048 (current time:1690157253048). 2023-07-24 00:07:33,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:07:33,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x79a1a65c to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:33,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4329a383, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:33,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:33,062 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:33,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79a1a65c to 127.0.0.1:56229 2023-07-24 00:07:33,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:33,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x1eedd40a to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:33,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a0a02cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:33,170 DEBUG [hconnection-0x64b181b4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:33,171 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:33,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1eedd40a to 127.0.0.1:56229 2023-07-24 00:07:33,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:33,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 00:07:33,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:07:33,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 00:07:33,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 00:07:33,182 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 00:07:33,183 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690157853183 2023-07-24 00:07:33,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 00:07:33,186 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:07:33,186 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:07:33,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 00:07:33,191 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 00:07:33,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-24 00:07:33,193 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 00:07:33,194 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690157853194 2023-07-24 00:07:33,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,205 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 00:07:33,205 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:33,207 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 00:07:33,207 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 00:07:33,207 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,207 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,209 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:33,209 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:33,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:33,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:33,209 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,209 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:33,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:33,209 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,209 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:07:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 00:07:33,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,211 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 00:07:33,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,211 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 00:07:33,211 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:33,211 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:33,212 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 00:07:33,212 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 00:07:33,212 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 00:07:33,212 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 00:07:33,212 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 00:07:33,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 00:07:33,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,213 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 00:07:33,213 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 00:07:33,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,213 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 00:07:33,213 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:33,215 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 00:07:33,215 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 00:07:33,215 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 00:07:33,216 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,218 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,218 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:33,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:33,218 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,218 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,218 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:33,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:33,219 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,219 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:33,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:33,219 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,219 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:33,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:33,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 00:07:33,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@474425c7[Count = 0] remaining members to acquire global barrier 2023-07-24 00:07:33,221 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 00:07:33,221 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,222 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:07:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,222 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 00:07:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:33,223 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:33,223 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. started... 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 00:07:33,223 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 00:07:33,224 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:07:33,224 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 493c5f7b756d8cb45c42e6e4a473706b: 2023-07-24 00:07:33,225 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,225 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:33,225 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/3cdcda6ae175434f987b860d14f50f41.8583f6eeb5abf99cbc0a04ca229bb63a->hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf/3cdcda6ae175434f987b860d14f50f41-top, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/86225f6e4fba42368729cdfea2343c78.2a7e58d1928887663cdc9fa0a7cecc61->hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf/86225f6e4fba42368729cdfea2343c78-top] hfiles 2023-07-24 00:07:33,225 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/3cdcda6ae175434f987b860d14f50f41.8583f6eeb5abf99cbc0a04ca229bb63a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,226 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/86225f6e4fba42368729cdfea2343c78.2a7e58d1928887663cdc9fa0a7cecc61 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 00:07:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 00:07:33,231 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 00:07:33,231 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:33,231 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 00:07:33,240 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. completed. 2023-07-24 00:07:33,240 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:33,241 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:33,241 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:33,241 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,241 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 00:07:33,241 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:07:33,250 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,250 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 00:07:33,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:33,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:33,250 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:33,250 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 00:07:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:07:33,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 00:07:33,261 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 00:07:33,261 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:07:33,261 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:07:33,261 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,261 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:33,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:33,270 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:33,270 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:33,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,271 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,273 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,274 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:33,274 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,287 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 00:07:33,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,289 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:33,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:33,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:33,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:33,292 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:33,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:33,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,297 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,292 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:33,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:33,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:33,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:33,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:33,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:33,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 00:07:33,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,387 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690157253183Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690157253292 (+109 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690157253292Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690157253298 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690157253323 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690157253387 (+64 ms) 2023-07-24 00:07:33,390 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 00:07:33,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 204 msec 2023-07-24 00:07:33,489 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:33,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 00:07:33,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:07:33,490 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490 2023-07-24 00:07:33,491 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46711, tgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490, rawTgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:07:33,519 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:07:33,519 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-683151689_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,519 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 00:07:33,529 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:33,556 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:33,556 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:33,557 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:33,557 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,661 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-2478579046555457374.jar 2023-07-24 00:07:34,661 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,662 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,738 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-5727829163290620338.jar 2023-07-24 00:07:34,739 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,740 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,740 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,741 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,741 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:34,743 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:07:34,743 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:07:34,744 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:07:34,744 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:07:34,745 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:07:34,746 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:07:34,746 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:07:34,747 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:07:34,747 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:07:34,748 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:07:34,749 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:34,750 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:34,750 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:34,751 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:34,751 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:34,752 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:34,753 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:36,143 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:07:36,146 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 00:07:36,148 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 00:07:36,209 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:07:36,271 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:07:36,271 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:07:36,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0005_000001 (auth:SIMPLE) 2023-07-24 00:07:41,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0005_000001 (auth:SIMPLE) 2023-07-24 00:07:44,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0005_000001 (auth:SIMPLE) 2023-07-24 00:07:49,903 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0005_000001 (auth:SIMPLE) 2023-07-24 00:07:51,476 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:07:51,481 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:07:51,505 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,505 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:07:51,506 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:07:51,506 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,506 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 00:07:51,506 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 00:07:51,507 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,507 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 00:07:51,507 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157253490/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 00:07:51,523 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 00:07:51,529 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157271529"}]},"ts":"1690157271529"} 2023-07-24 00:07:51,530 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 00:07:51,532 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 00:07:51,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, UNASSIGN}] 2023-07-24 00:07:51,535 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, UNASSIGN 2023-07-24 00:07:51,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=493c5f7b756d8cb45c42e6e4a473706b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:51,536 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690157271536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157271536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157271536"}]},"ts":"1690157271536"} 2023-07-24 00:07:51,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 493c5f7b756d8cb45c42e6e4a473706b, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:07:51,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 00:07:51,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:51,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 493c5f7b756d8cb45c42e6e4a473706b, disabling compactions & flushes 2023-07-24 00:07:51,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:51,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:51,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. after waiting 0 ms 2023-07-24 00:07:51,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:51,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 00:07:51,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:51,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b. 2023-07-24 00:07:51,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 493c5f7b756d8cb45c42e6e4a473706b: 2023-07-24 00:07:51,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:51,743 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=493c5f7b756d8cb45c42e6e4a473706b, regionState=CLOSED 2023-07-24 00:07:51,743 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690157271743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157271743"}]},"ts":"1690157271743"} 2023-07-24 00:07:51,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 00:07:51,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 493c5f7b756d8cb45c42e6e4a473706b, server=jenkins-hbase4.apache.org,34461,1690157167575 in 217 msec 2023-07-24 00:07:51,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 00:07:51,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=493c5f7b756d8cb45c42e6e4a473706b, UNASSIGN in 224 msec 2023-07-24 00:07:51,760 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157271760"}]},"ts":"1690157271760"} 2023-07-24 00:07:51,762 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 00:07:51,763 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 00:07:51,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 240 msec 2023-07-24 00:07:51,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 00:07:51,832 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 00:07:51,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,836 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,838 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,839 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,842 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,842 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,842 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,842 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 00:07:51,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 00:07:51,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 00:07:51,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 00:07:51,845 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,845 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:51,845 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,846 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:51,846 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,846 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,846 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:51,846 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:51,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 00:07:51,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:51,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:51,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:51,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:51,861 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:51,866 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:51,866 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:51,871 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/recovered.edits] 2023-07-24 00:07:51,874 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/recovered.edits] 2023-07-24 00:07:51,877 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/recovered.edits] 2023-07-24 00:07:51,879 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf/3cdcda6ae175434f987b860d14f50f41 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/cf/3cdcda6ae175434f987b860d14f50f41 2023-07-24 00:07:51,879 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/3cdcda6ae175434f987b860d14f50f41.8583f6eeb5abf99cbc0a04ca229bb63a to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/3cdcda6ae175434f987b860d14f50f41.8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:51,882 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/86225f6e4fba42368729cdfea2343c78.2a7e58d1928887663cdc9fa0a7cecc61 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/cf/86225f6e4fba42368729cdfea2343c78.2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:51,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/recovered.edits/8.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a/recovered.edits/8.seqid 2023-07-24 00:07:51,887 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf/86225f6e4fba42368729cdfea2343c78 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/cf/86225f6e4fba42368729cdfea2343c78 2023-07-24 00:07:51,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8583f6eeb5abf99cbc0a04ca229bb63a 2023-07-24 00:07:51,894 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/recovered.edits/12.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b/recovered.edits/12.seqid 2023-07-24 00:07:51,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/493c5f7b756d8cb45c42e6e4a473706b 2023-07-24 00:07:51,897 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/recovered.edits/8.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61/recovered.edits/8.seqid 2023-07-24 00:07:51,897 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a7e58d1928887663cdc9fa0a7cecc61 2023-07-24 00:07:51,897 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 00:07:51,900 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,902 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 00:07:51,913 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 00:07:51,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 00:07:51,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157271914"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:51,920 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 00:07:51,920 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 493c5f7b756d8cb45c42e6e4a473706b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690157250291.493c5f7b756d8cb45c42e6e4a473706b.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 00:07:51,920 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 00:07:51,920 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157271920"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:51,924 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 00:07:51,930 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:51,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 97 msec 2023-07-24 00:07:51,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 00:07:51,948 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 00:07:51,949 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:51,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:51,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:51,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 00:07:51,955 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157271955"}]},"ts":"1690157271955"} 2023-07-24 00:07:51,957 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 00:07:51,960 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 00:07:51,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, UNASSIGN}] 2023-07-24 00:07:51,964 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, UNASSIGN 2023-07-24 00:07:51,964 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, UNASSIGN 2023-07-24 00:07:51,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=45733e216aa4a243be4ee9a9a0a13ac7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:51,966 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157271965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157271965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157271965"}]},"ts":"1690157271965"} 2023-07-24 00:07:51,966 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c24802ae52434f9fd508bfd351141159, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:51,966 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157271966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157271966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157271966"}]},"ts":"1690157271966"} 2023-07-24 00:07:51,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 45733e216aa4a243be4ee9a9a0a13ac7, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:07:51,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c24802ae52434f9fd508bfd351141159, server=jenkins-hbase4.apache.org,41155,1690157167693}] 2023-07-24 00:07:52,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 00:07:52,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:52,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 45733e216aa4a243be4ee9a9a0a13ac7, disabling compactions & flushes 2023-07-24 00:07:52,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:52,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:52,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. after waiting 0 ms 2023-07-24 00:07:52,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:52,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:52,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c24802ae52434f9fd508bfd351141159, disabling compactions & flushes 2023-07-24 00:07:52,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:52,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:52,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. after waiting 0 ms 2023-07-24 00:07:52,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:52,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:07:52,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:52,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7. 2023-07-24 00:07:52,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 45733e216aa4a243be4ee9a9a0a13ac7: 2023-07-24 00:07:52,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:07:52,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:07:52,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159. 2023-07-24 00:07:52,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c24802ae52434f9fd508bfd351141159: 2023-07-24 00:07:52,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:52,173 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=45733e216aa4a243be4ee9a9a0a13ac7, regionState=CLOSED 2023-07-24 00:07:52,173 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157272173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157272173"}]},"ts":"1690157272173"} 2023-07-24 00:07:52,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:52,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c24802ae52434f9fd508bfd351141159, regionState=CLOSED 2023-07-24 00:07:52,179 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690157272179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157272179"}]},"ts":"1690157272179"} 2023-07-24 00:07:52,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 00:07:52,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 45733e216aa4a243be4ee9a9a0a13ac7, server=jenkins-hbase4.apache.org,32955,1690157167636 in 208 msec 2023-07-24 00:07:52,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 00:07:52,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c24802ae52434f9fd508bfd351141159, server=jenkins-hbase4.apache.org,41155,1690157167693 in 208 msec 2023-07-24 00:07:52,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45733e216aa4a243be4ee9a9a0a13ac7, UNASSIGN in 226 msec 2023-07-24 00:07:52,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-24 00:07:52,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c24802ae52434f9fd508bfd351141159, UNASSIGN in 227 msec 2023-07-24 00:07:52,194 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157272194"}]},"ts":"1690157272194"} 2023-07-24 00:07:52,195 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 00:07:52,197 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 00:07:52,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 254 msec 2023-07-24 00:07:52,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 00:07:52,258 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 00:07:52,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,263 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,264 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,265 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,268 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,268 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,268 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,268 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,268 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 00:07:52,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 00:07:52,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 00:07:52,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 00:07:52,271 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,271 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,271 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,271 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 00:07:52,272 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,272 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,272 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,272 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,274 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:52,274 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:52,277 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/recovered.edits] 2023-07-24 00:07:52,278 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/recovered.edits] 2023-07-24 00:07:52,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf/afa579675b5e4213a70f228d77a2f180 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/cf/afa579675b5e4213a70f228d77a2f180 2023-07-24 00:07:52,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7/recovered.edits/9.seqid 2023-07-24 00:07:52,288 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45733e216aa4a243be4ee9a9a0a13ac7 2023-07-24 00:07:52,288 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf/eaa9b78d3057481e940388e702781070 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/cf/eaa9b78d3057481e940388e702781070 2023-07-24 00:07:52,291 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159/recovered.edits/9.seqid 2023-07-24 00:07:52,291 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c24802ae52434f9fd508bfd351141159 2023-07-24 00:07:52,291 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 00:07:52,293 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,297 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 00:07:52,299 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 00:07:52,300 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,300 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 00:07:52,300 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157272300"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:52,300 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157272300"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:52,302 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 00:07:52,302 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45733e216aa4a243be4ee9a9a0a13ac7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690157246130.45733e216aa4a243be4ee9a9a0a13ac7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c24802ae52434f9fd508bfd351141159, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690157246130.c24802ae52434f9fd508bfd351141159.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 00:07:52,302 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 00:07:52,302 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157272302"}]},"ts":"9223372036854775807"} 2023-07-24 00:07:52,303 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 00:07:52,306 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 47 msec 2023-07-24 00:07:52,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 00:07:52,374 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 00:07:52,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 00:07:52,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,393 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 00:07:52,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 00:07:52,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 00:07:52,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 00:07:52,434 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 747) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:47494 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-256064605_1 at /127.0.0.1:43058 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4064 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:37847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:37598 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:33419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:46370 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=656 (was 385) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=4701 (was 5835) 2023-07-24 00:07:52,434 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 00:07:52,464 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=656, ProcessCount=184, AvailableMemoryMB=4697 2023-07-24 00:07:52,464 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 00:07:52,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:07:52,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:07:52,470 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:07:52,471 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 00:07:52,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:07:52,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 00:07:52,478 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,478 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,479 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 empty. 2023-07-24 00:07:52,479 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 empty. 2023-07-24 00:07:52,479 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,479 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 00:07:52,510 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 00:07:52,512 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1968beb86f967013440cd4b063cf6cb9, NAME => 'testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:07:52,512 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 03eac34c17d2a029fbcc2abda7974fc5, NAME => 'testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:07:52,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:52,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1968beb86f967013440cd4b063cf6cb9, disabling compactions & flushes 2023-07-24 00:07:52,558 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. after waiting 0 ms 2023-07-24 00:07:52,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,558 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1968beb86f967013440cd4b063cf6cb9: 2023-07-24 00:07:52,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:52,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 03eac34c17d2a029fbcc2abda7974fc5, disabling compactions & flushes 2023-07-24 00:07:52,565 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. after waiting 0 ms 2023-07-24 00:07:52,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,565 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 03eac34c17d2a029fbcc2abda7974fc5: 2023-07-24 00:07:52,568 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:07:52,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157272569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157272569"}]},"ts":"1690157272569"} 2023-07-24 00:07:52,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157272569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157272569"}]},"ts":"1690157272569"} 2023-07-24 00:07:52,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 00:07:52,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:07:52,579 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:07:52,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157272579"}]},"ts":"1690157272579"} 2023-07-24 00:07:52,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 00:07:52,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:07:52,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:07:52,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:07:52,588 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:07:52,588 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:07:52,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, ASSIGN}] 2023-07-24 00:07:52,591 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, ASSIGN 2023-07-24 00:07:52,591 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, ASSIGN 2023-07-24 00:07:52,592 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:07:52,592 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34461,1690157167575; forceNewPlan=false, retain=false 2023-07-24 00:07:52,742 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:07:52,746 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=03eac34c17d2a029fbcc2abda7974fc5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:52,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157272746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157272746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157272746"}]},"ts":"1690157272746"} 2023-07-24 00:07:52,747 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1968beb86f967013440cd4b063cf6cb9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:52,747 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157272747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157272747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157272747"}]},"ts":"1690157272747"} 2023-07-24 00:07:52,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 03eac34c17d2a029fbcc2abda7974fc5, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:07:52,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 1968beb86f967013440cd4b063cf6cb9, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:07:52,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 00:07:52,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1968beb86f967013440cd4b063cf6cb9, NAME => 'testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 00:07:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. service=AccessControlService 2023-07-24 00:07:52,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:52,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03eac34c17d2a029fbcc2abda7974fc5, NAME => 'testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 00:07:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. service=AccessControlService 2023-07-24 00:07:52,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:07:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:07:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,923 INFO [StoreOpener-1968beb86f967013440cd4b063cf6cb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,927 INFO [StoreOpener-03eac34c17d2a029fbcc2abda7974fc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,928 DEBUG [StoreOpener-03eac34c17d2a029fbcc2abda7974fc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf 2023-07-24 00:07:52,929 DEBUG [StoreOpener-03eac34c17d2a029fbcc2abda7974fc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf 2023-07-24 00:07:52,929 INFO [StoreOpener-03eac34c17d2a029fbcc2abda7974fc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03eac34c17d2a029fbcc2abda7974fc5 columnFamilyName cf 2023-07-24 00:07:52,930 INFO [StoreOpener-03eac34c17d2a029fbcc2abda7974fc5-1] regionserver.HStore(310): Store=03eac34c17d2a029fbcc2abda7974fc5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:52,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:07:52,936 DEBUG [StoreOpener-1968beb86f967013440cd4b063cf6cb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf 2023-07-24 00:07:52,936 DEBUG [StoreOpener-1968beb86f967013440cd4b063cf6cb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf 2023-07-24 00:07:52,936 INFO [StoreOpener-1968beb86f967013440cd4b063cf6cb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1968beb86f967013440cd4b063cf6cb9 columnFamilyName cf 2023-07-24 00:07:52,937 INFO [StoreOpener-1968beb86f967013440cd4b063cf6cb9-1] regionserver.HStore(310): Store=1968beb86f967013440cd4b063cf6cb9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:07:52,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:07:52,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03eac34c17d2a029fbcc2abda7974fc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64414979, jitterRate=-0.04014201462268829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:52,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03eac34c17d2a029fbcc2abda7974fc5: 2023-07-24 00:07:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5., pid=93, masterSystemTime=1690157272901 2023-07-24 00:07:52,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:52,944 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=03eac34c17d2a029fbcc2abda7974fc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:52,944 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157272944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157272944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157272944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157272944"}]},"ts":"1690157272944"} 2023-07-24 00:07:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:07:52,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-24 00:07:52,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 03eac34c17d2a029fbcc2abda7974fc5, server=jenkins-hbase4.apache.org,34461,1690157167575 in 197 msec 2023-07-24 00:07:52,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:07:52,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1968beb86f967013440cd4b063cf6cb9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62418726, jitterRate=-0.06988850235939026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:07:52,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1968beb86f967013440cd4b063cf6cb9: 2023-07-24 00:07:52,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, ASSIGN in 360 msec 2023-07-24 00:07:52,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9., pid=94, masterSystemTime=1690157272902 2023-07-24 00:07:52,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:52,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1968beb86f967013440cd4b063cf6cb9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:52,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157272957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157272957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157272957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157272957"}]},"ts":"1690157272957"} 2023-07-24 00:07:52,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-24 00:07:52,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 1968beb86f967013440cd4b063cf6cb9, server=jenkins-hbase4.apache.org,32955,1690157167636 in 208 msec 2023-07-24 00:07:52,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 00:07:52,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, ASSIGN in 374 msec 2023-07-24 00:07:52,964 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:07:52,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157272964"}]},"ts":"1690157272964"} 2023-07-24 00:07:52,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 00:07:52,970 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:07:52,970 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 00:07:52,972 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 00:07:52,974 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,974 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,974 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,974 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:07:52,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:52,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:52,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:52,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 00:07:52,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 509 msec 2023-07-24 00:07:53,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 00:07:53,076 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 00:07:53,076 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 00:07:53,076 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:07:53,080 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 00:07:53,080 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:07:53,080 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-24 00:07:53,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:07:53,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157273083 (current time:1690157273083). 2023-07-24 00:07:53,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:07:53,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x15def887 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:53,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3f91bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:53,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:53,099 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15def887 to 127.0.0.1:56229 2023-07-24 00:07:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x736855da to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:53,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@119081f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:53,108 DEBUG [hconnection-0x2291500f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:53,111 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:53,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x736855da to 127.0.0.1:56229 2023-07-24 00:07:53,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:53,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 00:07:53,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:07:53,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:07:53,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:07:53,122 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:07:53,123 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690157873123 2023-07-24 00:07:53,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:07:53,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 00:07:53,124 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:07:53,124 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:07:53,125 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:07:53,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 00:07:53,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 00:07:53,129 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 00:07:53,131 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690157873131 2023-07-24 00:07:53,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,143 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 00:07:53,143 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,144 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 00:07:53,144 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 00:07:53,145 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,145 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,151 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,151 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,151 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,151 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,152 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,152 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 00:07:53,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 00:07:53,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,154 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 00:07:53,154 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,154 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 00:07:53,156 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 00:07:53,156 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 00:07:53,156 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,156 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 00:07:53,157 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 00:07:53,157 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 00:07:53,157 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,157 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:07:53,157 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 00:07:53,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 00:07:53,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,158 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 00:07:53,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,158 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 00:07:53,158 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,160 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 00:07:53,160 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 00:07:53,160 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 00:07:53,160 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,160 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,166 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,166 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,166 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,168 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,168 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,171 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,171 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 00:07:53,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a4f54a3[Count = 1] remaining members to acquire global barrier 2023-07-24 00:07:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 00:07:53,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a4f54a3[Count = 0] remaining members to acquire global barrier 2023-07-24 00:07:53,175 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 00:07:53,175 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,177 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,177 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,178 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:07:53,178 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,178 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:53,178 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. started... 2023-07-24 00:07:53,177 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,182 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,182 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:07:53,181 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1968beb86f967013440cd4b063cf6cb9: 2023-07-24 00:07:53,178 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:53,182 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:53,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,182 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,182 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:07:53,182 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:53,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,182 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:07:53,182 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:07:53,182 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:53,183 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:53,182 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 00:07:53,183 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:07:53,183 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:53,183 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. started... 2023-07-24 00:07:53,184 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03eac34c17d2a029fbcc2abda7974fc5: 2023-07-24 00:07:53,184 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,184 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:53,185 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:07:53,192 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 00:07:53,193 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,193 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 00:07:53,213 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. completed. 2023-07-24 00:07:53,213 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 00:07:53,214 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:07:53,217 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 00:07:53,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 00:07:53,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,224 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:07:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:53,225 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:07:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:07:53,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 00:07:53,425 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:53,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:07:53,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:53,427 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 00:07:53,602 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. completed. 2023-07-24 00:07:53,602 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:53,602 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 00:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:07:53,605 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,605 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 00:07:53,605 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,605 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 00:07:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:07:53,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 00:07:53,617 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 00:07:53,617 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:07:53,617 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:07:53,617 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,617 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:07:53,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,619 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,620 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,620 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,620 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,620 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,621 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,622 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,625 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,625 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,626 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,630 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,631 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,631 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,631 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,632 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,632 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,632 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,629 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 00:07:53,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,712 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690157273123Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690157273632 (+509 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690157273632Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690157273648 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690157273666 (+18 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690157273711 (+45 ms) 2023-07-24 00:07:53,715 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 00:07:53,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 591 msec 2023-07-24 00:07:53,727 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:53,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:07:53,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:07:53,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:07:53,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34461] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:07:53,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 00:07:53,742 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:53,743 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:07:53,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:07:53,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157273759 (current time:1690157273759). 2023-07-24 00:07:53,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:07:53,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x42130f60 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:53,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aaa3e05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:53,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:53,785 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:53,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42130f60 to 127.0.0.1:56229 2023-07-24 00:07:53,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:53,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x61aa6853 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:07:53,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b180309, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:07:53,803 DEBUG [hconnection-0xf95879-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:07:53,807 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:07:53,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61aa6853 to 127.0.0.1:56229 2023-07-24 00:07:53,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:07:53,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 00:07:53,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:07:53,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:07:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:07:53,822 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:07:53,823 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690157873822 2023-07-24 00:07:53,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 00:07:53,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 00:07:53,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 00:07:53,827 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:07:53,827 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:07:53,828 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 00:07:53,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-24 00:07:53,831 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 00:07:53,831 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690157873831 2023-07-24 00:07:53,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,865 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 00:07:53,865 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,866 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 00:07:53,867 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 00:07:53,868 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,868 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,871 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,871 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,871 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,871 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,872 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,872 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 00:07:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 00:07:53,873 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,873 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 00:07:53,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,876 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 00:07:53,876 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 00:07:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,876 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 00:07:53,880 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:07:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 00:07:53,880 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 00:07:53,880 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 00:07:53,885 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 00:07:53,885 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 00:07:53,885 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 00:07:53,885 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 00:07:53,885 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 00:07:53,885 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 00:07:53,887 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,887 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,887 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:07:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 00:07:53,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cd70864[Count = 1] remaining members to acquire global barrier 2023-07-24 00:07:53,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 00:07:53,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cd70864[Count = 0] remaining members to acquire global barrier 2023-07-24 00:07:53,894 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 00:07:53,895 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,899 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,899 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,899 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:07:53,900 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:53,900 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:07:53,900 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. started... 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 00:07:53,900 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,900 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:07:53,900 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1968beb86f967013440cd4b063cf6cb9 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 00:07:53,900 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:53,900 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. started... 2023-07-24 00:07:53,900 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:07:53,901 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 03eac34c17d2a029fbcc2abda7974fc5 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 00:07:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 00:07:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 00:07:53,927 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:53,928 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/.tmp/cf/e58cdcc3fda74da08bb7d53a00b5540e 2023-07-24 00:07:53,928 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/.tmp/cf/bd062f27fe6949d7b9e5c6dcc35d9e40 2023-07-24 00:07:53,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:07:53,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:07:53,933 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:07:53,935 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/.tmp/cf/e58cdcc3fda74da08bb7d53a00b5540e as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf/e58cdcc3fda74da08bb7d53a00b5540e 2023-07-24 00:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/.tmp/cf/bd062f27fe6949d7b9e5c6dcc35d9e40 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf/bd062f27fe6949d7b9e5c6dcc35d9e40 2023-07-24 00:07:53,943 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf/bd062f27fe6949d7b9e5c6dcc35d9e40, entries=46, sequenceid=6, filesize=7.9 K 2023-07-24 00:07:53,944 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1968beb86f967013440cd4b063cf6cb9 in 44ms, sequenceid=6, compaction requested=false 2023-07-24 00:07:53,944 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 00:07:53,945 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1968beb86f967013440cd4b063cf6cb9: 2023-07-24 00:07:53,945 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,947 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:53,947 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf/bd062f27fe6949d7b9e5c6dcc35d9e40] hfiles 2023-07-24 00:07:53,947 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf/bd062f27fe6949d7b9e5c6dcc35d9e40 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,948 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf/e58cdcc3fda74da08bb7d53a00b5540e, entries=4, sequenceid=6, filesize=5.1 K 2023-07-24 00:07:53,950 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 03eac34c17d2a029fbcc2abda7974fc5 in 49ms, sequenceid=6, compaction requested=false 2023-07-24 00:07:53,951 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03eac34c17d2a029fbcc2abda7974fc5: 2023-07-24 00:07:53,951 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,951 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:07:53,952 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf/e58cdcc3fda74da08bb7d53a00b5540e] hfiles 2023-07-24 00:07:53,952 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf/e58cdcc3fda74da08bb7d53a00b5540e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,962 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. completed. 2023-07-24 00:07:53,962 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:07:53,962 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:53,962 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:07:53,963 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. completed. 2023-07-24 00:07:53,963 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 00:07:53,963 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:07:53,964 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 00:07:53,964 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,964 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,964 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 00:07:53,965 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 00:07:53,965 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,965 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 00:07:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:07:53,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 00:07:53,973 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 00:07:53,973 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:07:53,973 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:07:53,973 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,973 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,975 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:07:53,976 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:07:53,976 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,976 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:07:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,978 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:07:53,978 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,979 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,983 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:07:53,983 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:07:53,982 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:07:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,983 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:07:53,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:07:53,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:07:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:07:53,984 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:07:53,985 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:07:53,985 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,985 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:53,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:54,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:54,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 00:07:54,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:54,028 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:54,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690157273823Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690157273984 (+161 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690157273984Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690157273988 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690157274000 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690157274027 (+27 ms) 2023-07-24 00:07:54,031 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 00:07:54,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 205 msec 2023-07-24 00:07:54,133 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:07:54,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 00:07:54,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:07:54,134 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134 2023-07-24 00:07:54,135 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46711, tgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134, rawTgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:07:54,160 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:07:54,160 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1221710761_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:54,160 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 00:07:54,167 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:07:54,188 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:54,189 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:54,189 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:54,190 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,340 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-5841248356298944123.jar 2023-07-24 00:07:55,341 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,341 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,429 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-3817814513693754056.jar 2023-07-24 00:07:55,430 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,430 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,431 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,431 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,432 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,432 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:07:55,432 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:07:55,433 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:07:55,433 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:07:55,433 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:07:55,434 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:07:55,434 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:07:55,435 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:07:55,435 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:07:55,436 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:07:55,436 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:07:55,437 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:55,437 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:55,438 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:55,438 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:55,438 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:07:55,439 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:55,439 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:07:56,025 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0005_000001 (auth:SIMPLE) 2023-07-24 00:07:57,354 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:07:57,561 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:07:57,564 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 00:07:57,657 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:07:57,657 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:07:57,838 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0006_000001 (auth:SIMPLE) 2023-07-24 00:08:03,939 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0006_000001 (auth:SIMPLE) 2023-07-24 00:08:06,790 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:08:06,791 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:08:06,796 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:08:06,796 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:08:06,797 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:08:06,797 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:08:06,797 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 00:08:06,797 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 00:08:06,797 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:08:06,798 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 00:08:06,798 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157274134/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 00:08:06,803 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 00:08:06,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 00:08:06,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:06,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 00:08:06,808 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157286808"}]},"ts":"1690157286808"} 2023-07-24 00:08:06,809 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 00:08:06,811 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 00:08:06,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, UNASSIGN}] 2023-07-24 00:08:06,813 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, UNASSIGN 2023-07-24 00:08:06,814 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, UNASSIGN 2023-07-24 00:08:06,814 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=03eac34c17d2a029fbcc2abda7974fc5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:06,814 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157286814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157286814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157286814"}]},"ts":"1690157286814"} 2023-07-24 00:08:06,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1968beb86f967013440cd4b063cf6cb9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:06,815 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157286814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157286814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157286814"}]},"ts":"1690157286814"} 2023-07-24 00:08:06,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 03eac34c17d2a029fbcc2abda7974fc5, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:08:06,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 1968beb86f967013440cd4b063cf6cb9, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:08:06,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 00:08:06,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:08:06,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03eac34c17d2a029fbcc2abda7974fc5, disabling compactions & flushes 2023-07-24 00:08:06,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:08:06,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:08:06,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. after waiting 0 ms 2023-07-24 00:08:06,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:08:06,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:08:06,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1968beb86f967013440cd4b063cf6cb9, disabling compactions & flushes 2023-07-24 00:08:06,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:08:06,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:08:06,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. after waiting 0 ms 2023-07-24 00:08:06,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:08:07,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:08:07,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:08:07,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:07,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:07,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9. 2023-07-24 00:08:07,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1968beb86f967013440cd4b063cf6cb9: 2023-07-24 00:08:07,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5. 2023-07-24 00:08:07,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03eac34c17d2a029fbcc2abda7974fc5: 2023-07-24 00:08:07,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:08:07,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1968beb86f967013440cd4b063cf6cb9, regionState=CLOSED 2023-07-24 00:08:07,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157287096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157287096"}]},"ts":"1690157287096"} 2023-07-24 00:08:07,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:08:07,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=03eac34c17d2a029fbcc2abda7974fc5, regionState=CLOSED 2023-07-24 00:08:07,099 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690157287098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157287098"}]},"ts":"1690157287098"} 2023-07-24 00:08:07,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-24 00:08:07,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 1968beb86f967013440cd4b063cf6cb9, server=jenkins-hbase4.apache.org,32955,1690157167636 in 282 msec 2023-07-24 00:08:07,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-24 00:08:07,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 03eac34c17d2a029fbcc2abda7974fc5, server=jenkins-hbase4.apache.org,34461,1690157167575 in 286 msec 2023-07-24 00:08:07,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1968beb86f967013440cd4b063cf6cb9, UNASSIGN in 294 msec 2023-07-24 00:08:07,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 00:08:07,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=03eac34c17d2a029fbcc2abda7974fc5, UNASSIGN in 295 msec 2023-07-24 00:08:07,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157287111"}]},"ts":"1690157287111"} 2023-07-24 00:08:07,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 00:08:07,117 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 00:08:07,120 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 00:08:07,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 317 msec 2023-07-24 00:08:07,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 00:08:07,415 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 00:08:07,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,422 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,423 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,429 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,434 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,435 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,435 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 00:08:07,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 00:08:07,436 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:07,436 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,436 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,436 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:07,436 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:07,437 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:08:07,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 00:08:07,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 00:08:07,438 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:08:07,438 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 00:08:07,438 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,438 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:07,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 00:08:07,439 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 00:08:07,440 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/recovered.edits] 2023-07-24 00:08:07,442 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/recovered.edits] 2023-07-24 00:08:07,445 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf/bd062f27fe6949d7b9e5c6dcc35d9e40 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/cf/bd062f27fe6949d7b9e5c6dcc35d9e40 2023-07-24 00:08:07,449 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9/recovered.edits/9.seqid 2023-07-24 00:08:07,450 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/1968beb86f967013440cd4b063cf6cb9 2023-07-24 00:08:07,470 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf/e58cdcc3fda74da08bb7d53a00b5540e to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/cf/e58cdcc3fda74da08bb7d53a00b5540e 2023-07-24 00:08:07,480 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5/recovered.edits/9.seqid 2023-07-24 00:08:07,481 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testEmptyExportFileSystemState/03eac34c17d2a029fbcc2abda7974fc5 2023-07-24 00:08:07,481 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 00:08:07,485 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,489 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 00:08:07,495 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 00:08:07,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 00:08:07,497 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157287497"}]},"ts":"9223372036854775807"} 2023-07-24 00:08:07,497 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157287497"}]},"ts":"9223372036854775807"} 2023-07-24 00:08:07,500 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 00:08:07,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 03eac34c17d2a029fbcc2abda7974fc5, NAME => 'testtb-testEmptyExportFileSystemState,,1690157272466.03eac34c17d2a029fbcc2abda7974fc5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1968beb86f967013440cd4b063cf6cb9, NAME => 'testtb-testEmptyExportFileSystemState,1,1690157272466.1968beb86f967013440cd4b063cf6cb9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 00:08:07,500 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 00:08:07,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157287500"}]},"ts":"9223372036854775807"} 2023-07-24 00:08:07,502 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 00:08:07,504 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 00:08:07,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 88 msec 2023-07-24 00:08:07,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 00:08:07,539 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 00:08:07,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 00:08:07,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 00:08:07,555 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 00:08:07,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 00:08:07,611 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1397840990_1 at /127.0.0.1:44592 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:48246 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4836 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:38347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:53354 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:44620 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:33401 from appattempt_1690157176761_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=714 (was 656) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=4272 (was 4697) 2023-07-24 00:08:07,611 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 00:08:07,642 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=714, ProcessCount=181, AvailableMemoryMB=4270 2023-07-24 00:08:07,642 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 00:08:07,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 00:08:07,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:07,648 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 00:08:07,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 00:08:07,649 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 00:08:07,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 00:08:07,651 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:07,651 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:07,652 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f empty. 2023-07-24 00:08:07,652 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 empty. 2023-07-24 00:08:07,652 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:07,652 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:07,652 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 00:08:07,700 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 00:08:07,715 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => f4feba61cb93673f6babe0e054b93c5f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:08:07,725 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 28861260e45065602f3bbd6ce61b3499, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp 2023-07-24 00:08:07,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 00:08:07,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:08:07,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 28861260e45065602f3bbd6ce61b3499, disabling compactions & flushes 2023-07-24 00:08:07,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:07,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:07,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. after waiting 0 ms 2023-07-24 00:08:07,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:07,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:07,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 28861260e45065602f3bbd6ce61b3499: 2023-07-24 00:08:07,776 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:08:07,776 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing f4feba61cb93673f6babe0e054b93c5f, disabling compactions & flushes 2023-07-24 00:08:07,776 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:07,776 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:07,776 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. after waiting 0 ms 2023-07-24 00:08:07,776 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:07,776 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:07,776 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for f4feba61cb93673f6babe0e054b93c5f: 2023-07-24 00:08:07,780 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 00:08:07,781 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157287781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157287781"}]},"ts":"1690157287781"} 2023-07-24 00:08:07,781 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157287781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157287781"}]},"ts":"1690157287781"} 2023-07-24 00:08:07,797 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 00:08:07,798 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 00:08:07,798 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157287798"}]},"ts":"1690157287798"} 2023-07-24 00:08:07,799 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 00:08:07,804 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 00:08:07,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 00:08:07,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 00:08:07,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 00:08:07,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 00:08:07,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, ASSIGN}] 2023-07-24 00:08:07,812 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, ASSIGN 2023-07-24 00:08:07,813 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, ASSIGN 2023-07-24 00:08:07,814 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34461,1690157167575; forceNewPlan=false, retain=false 2023-07-24 00:08:07,814 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32955,1690157167636; forceNewPlan=false, retain=false 2023-07-24 00:08:07,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 00:08:07,964 INFO [jenkins-hbase4:46285] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 00:08:07,967 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f4feba61cb93673f6babe0e054b93c5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:07,967 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=28861260e45065602f3bbd6ce61b3499, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:07,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157287967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157287967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157287967"}]},"ts":"1690157287967"} 2023-07-24 00:08:07,968 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157287967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157287967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157287967"}]},"ts":"1690157287967"} 2023-07-24 00:08:07,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure f4feba61cb93673f6babe0e054b93c5f, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:08:07,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 28861260e45065602f3bbd6ce61b3499, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:08:08,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28861260e45065602f3bbd6ce61b3499, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 00:08:08,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. service=AccessControlService 2023-07-24 00:08:08,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:08:08,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:08:08,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4feba61cb93673f6babe0e054b93c5f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 00:08:08,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. service=AccessControlService 2023-07-24 00:08:08,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 00:08:08,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 00:08:08,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,131 INFO [StoreOpener-f4feba61cb93673f6babe0e054b93c5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,131 INFO [StoreOpener-28861260e45065602f3bbd6ce61b3499-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,137 DEBUG [StoreOpener-28861260e45065602f3bbd6ce61b3499-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf 2023-07-24 00:08:08,137 DEBUG [StoreOpener-28861260e45065602f3bbd6ce61b3499-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf 2023-07-24 00:08:08,138 INFO [StoreOpener-28861260e45065602f3bbd6ce61b3499-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28861260e45065602f3bbd6ce61b3499 columnFamilyName cf 2023-07-24 00:08:08,138 DEBUG [StoreOpener-f4feba61cb93673f6babe0e054b93c5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf 2023-07-24 00:08:08,138 DEBUG [StoreOpener-f4feba61cb93673f6babe0e054b93c5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf 2023-07-24 00:08:08,138 INFO [StoreOpener-28861260e45065602f3bbd6ce61b3499-1] regionserver.HStore(310): Store=28861260e45065602f3bbd6ce61b3499/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:08:08,138 INFO [StoreOpener-f4feba61cb93673f6babe0e054b93c5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4feba61cb93673f6babe0e054b93c5f columnFamilyName cf 2023-07-24 00:08:08,139 INFO [StoreOpener-f4feba61cb93673f6babe0e054b93c5f-1] regionserver.HStore(310): Store=f4feba61cb93673f6babe0e054b93c5f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 00:08:08,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:08,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:08,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:08:08,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4feba61cb93673f6babe0e054b93c5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61836382, jitterRate=-0.07856610417366028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:08:08,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4feba61cb93673f6babe0e054b93c5f: 2023-07-24 00:08:08,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 00:08:08,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f., pid=108, masterSystemTime=1690157288122 2023-07-24 00:08:08,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28861260e45065602f3bbd6ce61b3499; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69109992, jitterRate=0.029819130897521973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 00:08:08,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28861260e45065602f3bbd6ce61b3499: 2023-07-24 00:08:08,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499., pid=109, masterSystemTime=1690157288122 2023-07-24 00:08:08,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,151 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f4feba61cb93673f6babe0e054b93c5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,151 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157288151"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157288151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157288151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157288151"}]},"ts":"1690157288151"} 2023-07-24 00:08:08,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=28861260e45065602f3bbd6ce61b3499, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,153 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157288152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690157288152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690157288152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690157288152"}]},"ts":"1690157288152"} 2023-07-24 00:08:08,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-24 00:08:08,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure f4feba61cb93673f6babe0e054b93c5f, server=jenkins-hbase4.apache.org,34461,1690157167575 in 185 msec 2023-07-24 00:08:08,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-24 00:08:08,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 28861260e45065602f3bbd6ce61b3499, server=jenkins-hbase4.apache.org,32955,1690157167636 in 184 msec 2023-07-24 00:08:08,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, ASSIGN in 350 msec 2023-07-24 00:08:08,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-24 00:08:08,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, ASSIGN in 351 msec 2023-07-24 00:08:08,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 00:08:08,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157288160"}]},"ts":"1690157288160"} 2023-07-24 00:08:08,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 00:08:08,164 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 00:08:08,164 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 00:08:08,166 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 00:08:08,168 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:08,168 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:08,168 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:08,168 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:08,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 00:08:08,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 00:08:08,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 00:08:08,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 00:08:08,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 526 msec 2023-07-24 00:08:08,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 00:08:08,253 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 00:08:08,254 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-24 00:08:08,254 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:08:08,257 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-24 00:08:08,258 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:08:08,258 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-24 00:08:08,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 00:08:08,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157288260 (current time:1690157288260). 2023-07-24 00:08:08,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:08:08,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x448524b3 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:08:08,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ce786f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:08:08,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:08:08,275 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:08:08,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x448524b3 to 127.0.0.1:56229 2023-07-24 00:08:08,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:08,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x5cfc0bc6 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:08:08,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31b10c56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:08:08,291 DEBUG [hconnection-0x5181f4bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:08:08,292 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:08:08,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cfc0bc6 to 127.0.0.1:56229 2023-07-24 00:08:08,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 00:08:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:08:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 00:08:08,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 00:08:08,302 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 00:08:08,303 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690157888303 2023-07-24 00:08:08,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 00:08:08,305 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:08:08,305 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:08:08,305 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 00:08:08,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 00:08:08,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-24 00:08:08,307 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 00:08:08,308 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690157888308 2023-07-24 00:08:08,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,318 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 00:08:08,318 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,319 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 00:08:08,319 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 00:08:08,320 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,320 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,322 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,322 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,322 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,322 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,322 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,323 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,323 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 00:08:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 00:08:08,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 00:08:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 00:08:08,327 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 00:08:08,327 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 00:08:08,326 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 00:08:08,327 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 00:08:08,333 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,333 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,334 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:08:08,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,334 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:08:08,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cdf053d[Count = 1] remaining members to acquire global barrier 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 00:08:08,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cdf053d[Count = 0] remaining members to acquire global barrier 2023-07-24 00:08:08,338 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 00:08:08,338 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 00:08:08,340 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 00:08:08,340 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 00:08:08,340 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:08:08,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,340 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 00:08:08,340 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,340 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:08:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:08:08,341 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. started... 2023-07-24 00:08:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:08:08,341 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:08:08,341 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,342 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 28861260e45065602f3bbd6ce61b3499: 2023-07-24 00:08:08,341 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. started... 2023-07-24 00:08:08,342 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:08:08,343 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,344 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4feba61cb93673f6babe0e054b93c5f: 2023-07-24 00:08:08,344 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:08:08,344 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:08:08,344 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 00:08:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,344 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:08:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 00:08:08,345 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 00:08:08,363 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. completed. 2023-07-24 00:08:08,364 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:08:08,364 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. completed. 2023-07-24 00:08:08,364 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 00:08:08,364 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:08:08,367 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,367 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 00:08:08,367 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 00:08:08,367 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,368 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,367 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,368 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 00:08:08,369 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 00:08:08,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:08:08,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 00:08:08,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:08:08,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 00:08:08,378 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 00:08:08,378 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:08:08,378 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:08:08,378 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,378 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,383 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,384 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,383 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,384 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,388 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,388 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,388 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,393 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,392 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,393 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,393 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,393 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,406 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:08:08,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 00:08:08,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:08:08,407 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:08:08,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 00:08:08,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,453 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690157288303Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690157288393 (+90 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690157288395 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690157288398 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690157288423 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690157288452 (+29 ms) 2023-07-24 00:08:08,457 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 00:08:08,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 153 msec 2023-07-24 00:08:08,607 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:08:08,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 00:08:08,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:08:08,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34461] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:08:08,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32955] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 00:08:08,640 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,640 DEBUG [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,640 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 00:08:08,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 00:08:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690157288673 (current time:1690157288673). 2023-07-24 00:08:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 00:08:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x7c607b96 to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:08:08,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229a7c8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:08:08,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:08:08,685 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:08:08,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c607b96 to 127.0.0.1:56229 2023-07-24 00:08:08,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:08,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(139): Connect 0x6afa210f to 127.0.0.1:56229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 00:08:08,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15395b0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 00:08:08,693 DEBUG [hconnection-0x64363333-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 00:08:08,696 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 00:08:08,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6afa210f to 127.0.0.1:56229 2023-07-24 00:08:08,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:08,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 00:08:08,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 00:08:08,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 00:08:08,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 00:08:08,706 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 00:08:08,707 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690157888707 2023-07-24 00:08:08,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 00:08:08,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,708 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 00:08:08,708 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 00:08:08,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 00:08:08,709 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 00:08:08,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-24 00:08:08,711 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 00:08:08,712 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690157888712 2023-07-24 00:08:08,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,725 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 00:08:08,725 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,727 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 00:08:08,727 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 00:08:08,727 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,728 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,729 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,729 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,729 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,729 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,730 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,730 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,730 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,730 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 00:08:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 00:08:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 00:08:08,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 00:08:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,733 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 00:08:08,733 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 00:08:08,733 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 00:08:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 00:08:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 00:08:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 00:08:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 00:08:08,735 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,738 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,738 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:08:08,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,739 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 00:08:08,739 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 00:08:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 00:08:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 00:08:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 00:08:08,741 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 00:08:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 00:08:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 00:08:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41155,1690157167693' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 00:08:08,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,744 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,744 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,746 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,746 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,746 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:08:08,746 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,746 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 00:08:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34461,1690157167575' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a53717c[Count = 1] remaining members to acquire global barrier 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32955,1690157167636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 00:08:08,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a53717c[Count = 0] remaining members to acquire global barrier 2023-07-24 00:08:08,755 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 00:08:08,755 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,760 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,760 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,760 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 00:08:08,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 00:08:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 00:08:08,761 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:08:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:08:08,761 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. started... 2023-07-24 00:08:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41155,1690157167693' in zk 2023-07-24 00:08:08,761 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,761 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f4feba61cb93673f6babe0e054b93c5f 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 00:08:08,761 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,761 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 00:08:08,763 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,763 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 00:08:08,763 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 00:08:08,763 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,763 DEBUG [member: 'jenkins-hbase4.apache.org,41155,1690157167693' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 00:08:08,770 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 00:08:08,772 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,772 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 00:08:08,772 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. started... 2023-07-24 00:08:08,772 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 28861260e45065602f3bbd6ce61b3499 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 00:08:08,803 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/.tmp/cf/14d05de83c894f16bbbc501966c48b6f 2023-07-24 00:08:08,807 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/.tmp/cf/1fd25b541051405cb1098055ec4cd0b2 2023-07-24 00:08:08,808 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:08:08,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 00:08:08,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 00:08:08,810 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/.tmp/cf/14d05de83c894f16bbbc501966c48b6f as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf/14d05de83c894f16bbbc501966c48b6f 2023-07-24 00:08:08,810 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 00:08:08,814 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/.tmp/cf/1fd25b541051405cb1098055ec4cd0b2 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf/1fd25b541051405cb1098055ec4cd0b2 2023-07-24 00:08:08,819 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf/14d05de83c894f16bbbc501966c48b6f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 00:08:08,820 INFO [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f4feba61cb93673f6babe0e054b93c5f in 59ms, sequenceid=6, compaction requested=false 2023-07-24 00:08:08,820 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 00:08:08,820 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf/1fd25b541051405cb1098055ec4cd0b2, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 00:08:08,820 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4feba61cb93673f6babe0e054b93c5f: 2023-07-24 00:08:08,821 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,821 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:08:08,821 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf/14d05de83c894f16bbbc501966c48b6f] hfiles 2023-07-24 00:08:08,821 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf/14d05de83c894f16bbbc501966c48b6f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,821 INFO [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 28861260e45065602f3bbd6ce61b3499 in 49ms, sequenceid=6, compaction requested=false 2023-07-24 00:08:08,823 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 28861260e45065602f3bbd6ce61b3499: 2023-07-24 00:08:08,823 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,824 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 00:08:08,824 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf/1fd25b541051405cb1098055ec4cd0b2] hfiles 2023-07-24 00:08:08,824 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf/1fd25b541051405cb1098055ec4cd0b2 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,858 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. completed. 2023-07-24 00:08:08,859 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. completed. 2023-07-24 00:08:08,859 DEBUG [rs(jenkins-hbase4.apache.org,34461,1690157167575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:08,859 DEBUG [rs(jenkins-hbase4.apache.org,32955,1690157167636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34461,1690157167575' in zk 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 00:08:08,859 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32955,1690157167636' in zk 2023-07-24 00:08:08,861 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 00:08:08,861 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,861 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,861 DEBUG [member: 'jenkins-hbase4.apache.org,34461,1690157167575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 00:08:08,867 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,867 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 00:08:08,868 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,868 DEBUG [member: 'jenkins-hbase4.apache.org,32955,1690157167636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 00:08:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34461,1690157167575': 2023-07-24 00:08:08,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34461,1690157167575' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 00:08:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32955,1690157167636': 2023-07-24 00:08:08,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32955,1690157167636' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 00:08:08,877 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 00:08:08,877 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 00:08:08,877 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 00:08:08,878 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,878 INFO [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 00:08:08,879 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,879 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,879 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,879 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 00:08:08,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 00:08:08,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 00:08:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,883 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,883 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 00:08:08,883 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,885 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,885 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,886 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,890 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,890 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,890 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 00:08:08,890 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,890 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,890 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 00:08:08,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 00:08:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 00:08:08,891 DEBUG [(jenkins-hbase4.apache.org,46285,1690157165912)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 00:08:08,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,891 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 00:08:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,893 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:08,894 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:08,894 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,894 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 00:08:08,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,948 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:08,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690157288707Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690157288891 (+184 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690157288891Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690157288899 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690157288919 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690157288948 (+29 ms) 2023-07-24 00:08:08,951 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 00:08:08,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 243 msec 2023-07-24 00:08:09,010 DEBUG [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 00:08:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 00:08:09,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 00:08:09,012 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012 2023-07-24 00:08:09,012 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46711, tgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012, rawTgtDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012, srcFsUri=hdfs://localhost:46711, srcDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:08:09,038 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b 2023-07-24 00:08:09,038 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_55644811_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:09,038 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46711, inputRoot=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b, snapshotDir=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 00:08:09,059 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:09,116 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:09,117 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:09,117 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:09,118 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,163 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-4726005052082875598.jar 2023-07-24 00:08:10,164 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,164 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,247 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/hadoop-4247596122060879253.jar 2023-07-24 00:08:10,248 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,248 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,249 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,249 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,250 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,250 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 00:08:10,250 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 00:08:10,251 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 00:08:10,251 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 00:08:10,252 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 00:08:10,252 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 00:08:10,253 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 00:08:10,253 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 00:08:10,253 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 00:08:10,253 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 00:08:10,254 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 00:08:10,255 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:08:10,255 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:08:10,256 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:08:10,256 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:08:10,256 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 00:08:10,257 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:08:10,258 DEBUG [Listener at jenkins-hbase4.apache.org/43137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 00:08:11,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0006_000001 (auth:SIMPLE) 2023-07-24 00:08:11,546 WARN [Listener at jenkins-hbase4.apache.org/43137] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 00:08:11,549 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 00:08:11,551 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 00:08:11,616 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:08:11,616 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 00:08:12,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0007_000001 (auth:SIMPLE) 2023-07-24 00:08:12,735 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:08:18,141 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0007_000001 (auth:SIMPLE) 2023-07-24 00:08:20,502 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0007_000001 (auth:SIMPLE) 2023-07-24 00:08:26,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690157176761_0007_000001 (auth:SIMPLE) 2023-07-24 00:08:27,816 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 00:08:27,816 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 00:08:27,848 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:27,848 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 00:08:27,849 INFO [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 00:08:27,849 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:27,850 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 00:08:27,850 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 00:08:27,850 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_221156019_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:27,851 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 00:08:27,851 DEBUG [Listener at jenkins-hbase4.apache.org/43137] snapshot.TestExportSnapshot(367): hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/export-test/export-1690157289012/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 00:08:27,871 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:27,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:27,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:27,879 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157307879"}]},"ts":"1690157307879"} 2023-07-24 00:08:27,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 00:08:27,881 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 00:08:27,883 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 00:08:27,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, UNASSIGN}] 2023-07-24 00:08:27,886 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, UNASSIGN 2023-07-24 00:08:27,889 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, UNASSIGN 2023-07-24 00:08:27,891 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=28861260e45065602f3bbd6ce61b3499, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:27,891 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157307890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157307890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157307890"}]},"ts":"1690157307890"} 2023-07-24 00:08:27,891 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f4feba61cb93673f6babe0e054b93c5f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:27,891 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157307891"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690157307891"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690157307891"}]},"ts":"1690157307891"} 2023-07-24 00:08:27,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 28861260e45065602f3bbd6ce61b3499, server=jenkins-hbase4.apache.org,32955,1690157167636}] 2023-07-24 00:08:27,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure f4feba61cb93673f6babe0e054b93c5f, server=jenkins-hbase4.apache.org,34461,1690157167575}] 2023-07-24 00:08:27,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 00:08:28,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:28,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28861260e45065602f3bbd6ce61b3499, disabling compactions & flushes 2023-07-24 00:08:28,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:28,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:28,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. after waiting 0 ms 2023-07-24 00:08:28,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:28,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:28,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4feba61cb93673f6babe0e054b93c5f, disabling compactions & flushes 2023-07-24 00:08:28,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:28,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:28,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. after waiting 0 ms 2023-07-24 00:08:28,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:28,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:08:28,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:08:28,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:28,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f. 2023-07-24 00:08:28,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4feba61cb93673f6babe0e054b93c5f: 2023-07-24 00:08:28,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:28,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499. 2023-07-24 00:08:28,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28861260e45065602f3bbd6ce61b3499: 2023-07-24 00:08:28,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:28,080 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f4feba61cb93673f6babe0e054b93c5f, regionState=CLOSED 2023-07-24 00:08:28,080 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157308080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157308080"}]},"ts":"1690157308080"} 2023-07-24 00:08:28,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:28,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=28861260e45065602f3bbd6ce61b3499, regionState=CLOSED 2023-07-24 00:08:28,081 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690157308081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690157308081"}]},"ts":"1690157308081"} 2023-07-24 00:08:28,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 00:08:28,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure f4feba61cb93673f6babe0e054b93c5f, server=jenkins-hbase4.apache.org,34461,1690157167575 in 185 msec 2023-07-24 00:08:28,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 00:08:28,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 28861260e45065602f3bbd6ce61b3499, server=jenkins-hbase4.apache.org,32955,1690157167636 in 189 msec 2023-07-24 00:08:28,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f4feba61cb93673f6babe0e054b93c5f, UNASSIGN in 203 msec 2023-07-24 00:08:28,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-24 00:08:28,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=28861260e45065602f3bbd6ce61b3499, UNASSIGN in 203 msec 2023-07-24 00:08:28,090 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690157308090"}]},"ts":"1690157308090"} 2023-07-24 00:08:28,091 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 00:08:28,093 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 00:08:28,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 223 msec 2023-07-24 00:08:28,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 00:08:28,183 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 00:08:28,186 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,190 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,191 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,193 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,197 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,197 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,197 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,197 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,198 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 00:08:28,198 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 00:08:28,198 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:28,198 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 00:08:28,199 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:28,201 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/recovered.edits] 2023-07-24 00:08:28,201 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,201 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:28,201 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,201 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:28,201 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,201 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:28,202 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf, FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/recovered.edits] 2023-07-24 00:08:28,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 00:08:28,203 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 00:08:28,203 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 00:08:28,206 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf/1fd25b541051405cb1098055ec4cd0b2 to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/cf/1fd25b541051405cb1098055ec4cd0b2 2023-07-24 00:08:28,208 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf/14d05de83c894f16bbbc501966c48b6f to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/cf/14d05de83c894f16bbbc501966c48b6f 2023-07-24 00:08:28,213 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f/recovered.edits/9.seqid 2023-07-24 00:08:28,214 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f4feba61cb93673f6babe0e054b93c5f 2023-07-24 00:08:28,215 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/recovered.edits/9.seqid to hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499/recovered.edits/9.seqid 2023-07-24 00:08:28,216 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/28861260e45065602f3bbd6ce61b3499 2023-07-24 00:08:28,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 00:08:28,227 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,230 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 00:08:28,234 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 00:08:28,235 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,235 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 00:08:28,235 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157308235"}]},"ts":"9223372036854775807"} 2023-07-24 00:08:28,235 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690157308235"}]},"ts":"9223372036854775807"} 2023-07-24 00:08:28,238 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 00:08:28,238 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f4feba61cb93673f6babe0e054b93c5f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690157287644.f4feba61cb93673f6babe0e054b93c5f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 28861260e45065602f3bbd6ce61b3499, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690157287644.28861260e45065602f3bbd6ce61b3499.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 00:08:28,238 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 00:08:28,238 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690157308238"}]},"ts":"9223372036854775807"} 2023-07-24 00:08:28,253 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 00:08:28,255 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 69 msec 2023-07-24 00:08:28,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 00:08:28,304 INFO [Listener at jenkins-hbase4.apache.org/43137] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 00:08:28,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 00:08:28,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 00:08:28,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46285] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 00:08:28,362 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 763) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:45606 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-48 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5443 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-670017209_1 at /127.0.0.1:51468 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_55644811_17 at /127.0.0.1:51888 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:45009 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_221156019_17 at /127.0.0.1:51494 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-670017209_1 at /127.0.0.1:45576 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6da11b8b-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 915), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=696 (was 714), ProcessCount=181 (was 181), AvailableMemoryMB=4043 (was 4270) 2023-07-24 00:08:28,362 WARN [Listener at jenkins-hbase4.apache.org/43137] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-24 00:08:28,363 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 00:08:28,388 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 00:08:28,500 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690157176761_0007_01_000001 is : 143 2023-07-24 00:08:33,655 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 00:08:42,543 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 00:08:56,663 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 00:08:56,663 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 00:08:56,773 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 00:08:56,783 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 00:08:56,786 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 00:08:56,797 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 00:08:56,900 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 00:08:56,900 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 00:08:56,901 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 00:08:56,901 INFO [Listener at jenkins-hbase4.apache.org/43137] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 00:08:56,901 DEBUG [Listener at jenkins-hbase4.apache.org/43137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c45df17 to 127.0.0.1:56229 2023-07-24 00:08:56,901 DEBUG [Listener at jenkins-hbase4.apache.org/43137] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:56,901 DEBUG [Listener at jenkins-hbase4.apache.org/43137] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 00:08:56,901 DEBUG [Listener at jenkins-hbase4.apache.org/43137] util.JVMClusterUtil(257): Found active master hash=1708605551, stopped=false 2023-07-24 00:08:56,901 DEBUG [Listener at jenkins-hbase4.apache.org/43137] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:56,902 DEBUG [Listener at jenkins-hbase4.apache.org/43137] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 00:08:56,902 INFO [Listener at jenkins-hbase4.apache.org/43137] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:08:56,903 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 00:08:56,903 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 00:08:56,903 INFO [Listener at jenkins-hbase4.apache.org/43137] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 00:08:56,903 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:08:56,903 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 00:08:56,903 DEBUG [Listener at jenkins-hbase4.apache.org/43137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4421d33a to 127.0.0.1:56229 2023-07-24 00:08:56,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:08:56,903 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 00:08:56,904 DEBUG [Listener at jenkins-hbase4.apache.org/43137] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:56,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:08:56,904 INFO [Listener at jenkins-hbase4.apache.org/43137] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34461,1690157167575' ***** 2023-07-24 00:08:56,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:08:56,904 DEBUG [Listener at jenkins-hbase4.apache.org/43137] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:56,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 00:08:56,904 INFO [Listener at jenkins-hbase4.apache.org/43137] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 00:08:56,904 INFO [Listener at jenkins-hbase4.apache.org/43137] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32955,1690157167636' ***** 2023-07-24 00:08:56,904 DEBUG [Listener at jenkins-hbase4.apache.org/43137] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:56,904 INFO [Listener at jenkins-hbase4.apache.org/43137] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 00:08:56,904 INFO [RS:0;jenkins-hbase4:34461] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 00:08:56,905 INFO [Listener at jenkins-hbase4.apache.org/43137] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41155,1690157167693' ***** 2023-07-24 00:08:56,905 INFO [RS:0;jenkins-hbase4:34461] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 00:08:56,905 INFO [RS:1;jenkins-hbase4:32955] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 00:08:56,905 INFO [RS:0;jenkins-hbase4:34461] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 00:08:56,905 INFO [RS:1;jenkins-hbase4:32955] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 00:08:56,905 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:56,905 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 00:08:56,905 DEBUG [RS:0;jenkins-hbase4:34461] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45cf7bd4 to 127.0.0.1:56229 2023-07-24 00:08:56,905 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 00:08:56,905 DEBUG [Listener at jenkins-hbase4.apache.org/43137] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:56,905 DEBUG [RS:0;jenkins-hbase4:34461] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:56,905 INFO [RS:1;jenkins-hbase4:32955] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 00:08:56,905 INFO [Listener at jenkins-hbase4.apache.org/43137] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 00:08:56,907 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34461,1690157167575; all regions closed. 2023-07-24 00:08:56,907 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(3305): Received CLOSE for d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:08:56,907 INFO [RS:2;jenkins-hbase4:41155] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 00:08:56,907 INFO [RS:2;jenkins-hbase4:41155] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 00:08:56,907 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 00:08:56,907 INFO [RS:2;jenkins-hbase4:41155] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 00:08:56,907 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:56,907 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(3305): Received CLOSE for 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:08:56,907 DEBUG [RS:1;jenkins-hbase4:32955] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f7498bc to 127.0.0.1:56229 2023-07-24 00:08:56,908 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:56,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d011f7cc508caea71a587fe5802cfdda, disabling compactions & flushes 2023-07-24 00:08:56,908 DEBUG [RS:2;jenkins-hbase4:41155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c83ded0 to 127.0.0.1:56229 2023-07-24 00:08:56,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d53b70fd383073a4b2f482854421af3, disabling compactions & flushes 2023-07-24 00:08:56,908 DEBUG [RS:1;jenkins-hbase4:32955] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:56,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:08:56,909 DEBUG [RS:2;jenkins-hbase4:41155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:56,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:08:56,911 INFO [RS:2;jenkins-hbase4:41155] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 00:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:08:56,910 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 00:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. after waiting 0 ms 2023-07-24 00:08:56,911 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1478): Online Regions={d011f7cc508caea71a587fe5802cfdda=hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda.} 2023-07-24 00:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. after waiting 0 ms 2023-07-24 00:08:56,911 INFO [RS:2;jenkins-hbase4:41155] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 00:08:56,911 INFO [RS:2;jenkins-hbase4:41155] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 00:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:08:56,912 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 00:08:56,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d011f7cc508caea71a587fe5802cfdda 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 00:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:08:56,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6d53b70fd383073a4b2f482854421af3 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 00:08:56,912 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 00:08:56,912 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 6d53b70fd383073a4b2f482854421af3=hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3.} 2023-07-24 00:08:56,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 00:08:56,912 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 00:08:56,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 00:08:56,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 00:08:56,913 DEBUG [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1504): Waiting on d011f7cc508caea71a587fe5802cfdda 2023-07-24 00:08:56,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 00:08:56,913 DEBUG [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1504): Waiting on 1588230740, 6d53b70fd383073a4b2f482854421af3 2023-07-24 00:08:56,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 00:08:56,914 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 00:08:56,944 DEBUG [RS:0;jenkins-hbase4:34461] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs 2023-07-24 00:08:56,945 INFO [RS:0;jenkins-hbase4:34461] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34461%2C1690157167575:(num 1690157169860) 2023-07-24 00:08:56,945 DEBUG [RS:0;jenkins-hbase4:34461] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:56,945 INFO [RS:0;jenkins-hbase4:34461] regionserver.LeaseManager(133): Closed leases 2023-07-24 00:08:56,951 INFO [RS:0;jenkins-hbase4:34461] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 00:08:56,951 INFO [RS:0;jenkins-hbase4:34461] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 00:08:56,951 INFO [RS:0;jenkins-hbase4:34461] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 00:08:56,951 INFO [RS:0;jenkins-hbase4:34461] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 00:08:56,951 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 00:08:56,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/.tmp/info/f4d9c586a11b4d07a0b5ad80cb1fe518 2023-07-24 00:08:56,962 INFO [RS:0;jenkins-hbase4:34461] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34461 2023-07-24 00:08:56,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/.tmp/info/ea4ed65c89b845db9927a36114a1eef7 2023-07-24 00:08:56,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/.tmp/l/d9783a54af144b3ab6040eaa7c28869c 2023-07-24 00:08:56,971 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 00:08:56,974 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea4ed65c89b845db9927a36114a1eef7 2023-07-24 00:08:56,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/.tmp/info/f4d9c586a11b4d07a0b5ad80cb1fe518 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/info/f4d9c586a11b4d07a0b5ad80cb1fe518 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34461,1690157167575 2023-07-24 00:08:56,989 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:08:56,990 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34461,1690157167575] 2023-07-24 00:08:56,992 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 00:08:56,992 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34461,1690157167575; numProcessing=1 2023-07-24 00:08:56,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9783a54af144b3ab6040eaa7c28869c 2023-07-24 00:08:56,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/.tmp/l/d9783a54af144b3ab6040eaa7c28869c as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/l/d9783a54af144b3ab6040eaa7c28869c 2023-07-24 00:08:56,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/info/f4d9c586a11b4d07a0b5ad80cb1fe518, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 00:08:56,995 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34461,1690157167575 already deleted, retry=false 2023-07-24 00:08:56,995 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34461,1690157167575 expired; onlineServers=2 2023-07-24 00:08:56,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d011f7cc508caea71a587fe5802cfdda in 84ms, sequenceid=6, compaction requested=false 2023-07-24 00:08:57,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9783a54af144b3ab6040eaa7c28869c 2023-07-24 00:08:57,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/l/d9783a54af144b3ab6040eaa7c28869c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 00:08:57,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6d53b70fd383073a4b2f482854421af3 in 89ms, sequenceid=18, compaction requested=false 2023-07-24 00:08:57,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/.tmp/rep_barrier/61ab7b10049b4036bf734ecc6b582107 2023-07-24 00:08:57,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/namespace/d011f7cc508caea71a587fe5802cfdda/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 00:08:57,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:57,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:08:57,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d011f7cc508caea71a587fe5802cfdda: 2023-07-24 00:08:57,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690157170520.d011f7cc508caea71a587fe5802cfdda. 2023-07-24 00:08:57,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61ab7b10049b4036bf734ecc6b582107 2023-07-24 00:08:57,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/acl/6d53b70fd383073a4b2f482854421af3/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 00:08:57,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:57,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:08:57,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d53b70fd383073a4b2f482854421af3: 2023-07-24 00:08:57,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690157171367.6d53b70fd383073a4b2f482854421af3. 2023-07-24 00:08:57,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/.tmp/table/cde5e80678a246d7a13d8fa942fa1c09 2023-07-24 00:08:57,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cde5e80678a246d7a13d8fa942fa1c09 2023-07-24 00:08:57,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/.tmp/info/ea4ed65c89b845db9927a36114a1eef7 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/info/ea4ed65c89b845db9927a36114a1eef7 2023-07-24 00:08:57,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea4ed65c89b845db9927a36114a1eef7 2023-07-24 00:08:57,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/info/ea4ed65c89b845db9927a36114a1eef7, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 00:08:57,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/.tmp/rep_barrier/61ab7b10049b4036bf734ecc6b582107 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/rep_barrier/61ab7b10049b4036bf734ecc6b582107 2023-07-24 00:08:57,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61ab7b10049b4036bf734ecc6b582107 2023-07-24 00:08:57,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/rep_barrier/61ab7b10049b4036bf734ecc6b582107, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 00:08:57,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/.tmp/table/cde5e80678a246d7a13d8fa942fa1c09 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/table/cde5e80678a246d7a13d8fa942fa1c09 2023-07-24 00:08:57,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cde5e80678a246d7a13d8fa942fa1c09 2023-07-24 00:08:57,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/table/cde5e80678a246d7a13d8fa942fa1c09, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 00:08:57,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 147ms, sequenceid=131, compaction requested=false 2023-07-24 00:08:57,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 00:08:57,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 00:08:57,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 00:08:57,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 00:08:57,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 00:08:57,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 00:08:57,095 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,095 INFO [RS:0;jenkins-hbase4:34461] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34461,1690157167575; zookeeper connection closed. 2023-07-24 00:08:57,095 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:34461-0x10194a62c510001, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,100 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fbf6363] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fbf6363 2023-07-24 00:08:57,113 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32955,1690157167636; all regions closed. 2023-07-24 00:08:57,113 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41155,1690157167693; all regions closed. 2023-07-24 00:08:57,125 DEBUG [RS:1;jenkins-hbase4:32955] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs 2023-07-24 00:08:57,125 INFO [RS:1;jenkins-hbase4:32955] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32955%2C1690157167636:(num 1690157169874) 2023-07-24 00:08:57,126 DEBUG [RS:1;jenkins-hbase4:32955] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:57,126 INFO [RS:1;jenkins-hbase4:32955] regionserver.LeaseManager(133): Closed leases 2023-07-24 00:08:57,126 INFO [RS:1;jenkins-hbase4:32955] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 00:08:57,127 INFO [RS:1;jenkins-hbase4:32955] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 00:08:57,127 INFO [RS:1;jenkins-hbase4:32955] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 00:08:57,127 INFO [RS:1;jenkins-hbase4:32955] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 00:08:57,127 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 00:08:57,129 INFO [RS:1;jenkins-hbase4:32955] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32955 2023-07-24 00:08:57,130 DEBUG [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs 2023-07-24 00:08:57,130 INFO [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41155%2C1690157167693.meta:.meta(num 1690157170076) 2023-07-24 00:08:57,131 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:57,131 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:08:57,131 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32955,1690157167636 2023-07-24 00:08:57,132 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32955,1690157167636] 2023-07-24 00:08:57,132 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32955,1690157167636; numProcessing=2 2023-07-24 00:08:57,133 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32955,1690157167636 already deleted, retry=false 2023-07-24 00:08:57,133 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32955,1690157167636 expired; onlineServers=1 2023-07-24 00:08:57,145 DEBUG [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/oldWALs 2023-07-24 00:08:57,145 INFO [RS:2;jenkins-hbase4:41155] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41155%2C1690157167693:(num 1690157169872) 2023-07-24 00:08:57,145 DEBUG [RS:2;jenkins-hbase4:41155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:57,145 INFO [RS:2;jenkins-hbase4:41155] regionserver.LeaseManager(133): Closed leases 2023-07-24 00:08:57,146 INFO [RS:2;jenkins-hbase4:41155] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 00:08:57,146 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 00:08:57,147 INFO [RS:2;jenkins-hbase4:41155] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41155 2023-07-24 00:08:57,150 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 00:08:57,150 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41155,1690157167693 2023-07-24 00:08:57,150 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41155,1690157167693] 2023-07-24 00:08:57,150 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41155,1690157167693; numProcessing=3 2023-07-24 00:08:57,153 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41155,1690157167693 already deleted, retry=false 2023-07-24 00:08:57,153 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41155,1690157167693 expired; onlineServers=0 2023-07-24 00:08:57,153 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46285,1690157165912' ***** 2023-07-24 00:08:57,153 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 00:08:57,154 DEBUG [M:0;jenkins-hbase4:46285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24ea4a54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 00:08:57,154 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46285,1690157165912 2023-07-24 00:08:57,154 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46285,1690157165912; all regions closed. 2023-07-24 00:08:57,154 DEBUG [M:0;jenkins-hbase4:46285] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 00:08:57,154 DEBUG [M:0;jenkins-hbase4:46285] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 00:08:57,154 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 00:08:57,154 DEBUG [M:0;jenkins-hbase4:46285] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 00:08:57,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690157169399] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690157169399,5,FailOnTimeoutGroup] 2023-07-24 00:08:57,155 INFO [M:0;jenkins-hbase4:46285] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 00:08:57,155 INFO [M:0;jenkins-hbase4:46285] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 00:08:57,155 INFO [M:0;jenkins-hbase4:46285] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 00:08:57,155 DEBUG [M:0;jenkins-hbase4:46285] master.HMaster(1512): Stopping service threads 2023-07-24 00:08:57,155 INFO [M:0;jenkins-hbase4:46285] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 00:08:57,155 ERROR [M:0;jenkins-hbase4:46285] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 00:08:57,156 INFO [M:0;jenkins-hbase4:46285] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 00:08:57,156 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 00:08:57,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690157169399] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690157169399,5,FailOnTimeoutGroup] 2023-07-24 00:08:57,234 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,234 INFO [RS:1;jenkins-hbase4:32955] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32955,1690157167636; zookeeper connection closed. 2023-07-24 00:08:57,234 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:32955-0x10194a62c510002, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,234 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e1a9e29] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e1a9e29 2023-07-24 00:08:57,253 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,253 INFO [RS:2;jenkins-hbase4:41155] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41155,1690157167693; zookeeper connection closed. 2023-07-24 00:08:57,253 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): regionserver:41155-0x10194a62c510003, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,254 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c06f1f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c06f1f 2023-07-24 00:08:57,254 INFO [Listener at jenkins-hbase4.apache.org/43137] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 00:08:57,255 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 00:08:57,255 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 00:08:57,255 INFO [M:0;jenkins-hbase4:46285] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 00:08:57,256 INFO [M:0;jenkins-hbase4:46285] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 00:08:57,256 DEBUG [M:0;jenkins-hbase4:46285] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 00:08:57,256 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:08:57,256 DEBUG [M:0;jenkins-hbase4:46285] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:08:57,257 DEBUG [M:0;jenkins-hbase4:46285] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 00:08:57,257 DEBUG [M:0;jenkins-hbase4:46285] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:08:57,257 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.37 KB heapSize=449.55 KB 2023-07-24 00:08:57,257 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-24 00:08:57,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 00:08:57,257 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-24 00:08:57,271 INFO [M:0;jenkins-hbase4:46285] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.37 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/45f6c38b624b49d2adc4c6742a08e8a1 2023-07-24 00:08:57,276 INFO [M:0;jenkins-hbase4:46285] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45f6c38b624b49d2adc4c6742a08e8a1 2023-07-24 00:08:57,277 DEBUG [M:0;jenkins-hbase4:46285] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/45f6c38b624b49d2adc4c6742a08e8a1 as hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/45f6c38b624b49d2adc4c6742a08e8a1 2023-07-24 00:08:57,280 INFO [M:0;jenkins-hbase4:46285] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45f6c38b624b49d2adc4c6742a08e8a1 2023-07-24 00:08:57,280 INFO [M:0;jenkins-hbase4:46285] regionserver.HStore(1080): Added hdfs://localhost:46711/user/jenkins/test-data/e02978af-2438-b6e3-8d16-7ce4c81a6d5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/45f6c38b624b49d2adc4c6742a08e8a1, entries=119, sequenceid=899, filesize=28.5 K 2023-07-24 00:08:57,281 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegion(2948): Finished flush of dataSize ~373.37 KB/382331, heapSize ~449.53 KB/460320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-07-24 00:08:57,283 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 00:08:57,283 DEBUG [M:0;jenkins-hbase4:46285] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 00:08:57,291 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 00:08:57,291 INFO [M:0;jenkins-hbase4:46285] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 00:08:57,292 INFO [M:0;jenkins-hbase4:46285] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46285 2023-07-24 00:08:57,293 DEBUG [M:0;jenkins-hbase4:46285] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46285,1690157165912 already deleted, retry=false 2023-07-24 00:08:57,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,395 DEBUG [Listener at localhost/44909-EventThread] zookeeper.ZKWatcher(600): master:46285-0x10194a62c510000, quorum=127.0.0.1:56229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 00:08:57,395 INFO [M:0;jenkins-hbase4:46285] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46285,1690157165912; zookeeper connection closed. 2023-07-24 00:08:57,397 WARN [Listener at jenkins-hbase4.apache.org/43137] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 00:08:57,402 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 00:08:57,507 WARN [BP-1923158660-172.31.14.131-1690157161479 heartbeating to localhost/127.0.0.1:46711] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 00:08:57,508 WARN [BP-1923158660-172.31.14.131-1690157161479 heartbeating to localhost/127.0.0.1:46711] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1923158660-172.31.14.131-1690157161479 (Datanode Uuid b51d80d7-75f4-4669-8569-3c2ef4409c15) service to localhost/127.0.0.1:46711 2023-07-24 00:08:57,510 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data5/current/BP-1923158660-172.31.14.131-1690157161479] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 00:08:57,511 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data6/current/BP-1923158660-172.31.14.131-1690157161479] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 00:08:57,513 WARN [Listener at jenkins-hbase4.apache.org/43137] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 00:08:57,516 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 00:08:57,620 WARN [BP-1923158660-172.31.14.131-1690157161479 heartbeating to localhost/127.0.0.1:46711] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 00:08:57,620 WARN [BP-1923158660-172.31.14.131-1690157161479 heartbeating to localhost/127.0.0.1:46711] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1923158660-172.31.14.131-1690157161479 (Datanode Uuid b79e79fc-746f-4430-9060-01505470011b) service to localhost/127.0.0.1:46711 2023-07-24 00:08:57,621 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data3/current/BP-1923158660-172.31.14.131-1690157161479] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 00:08:57,621 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data4/current/BP-1923158660-172.31.14.131-1690157161479] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 00:08:57,622 WARN [Listener at jenkins-hbase4.apache.org/43137] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 00:08:57,625 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 00:08:57,729 WARN [BP-1923158660-172.31.14.131-1690157161479 heartbeating to localhost/127.0.0.1:46711] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 00:08:57,729 WARN [BP-1923158660-172.31.14.131-1690157161479 heartbeating to localhost/127.0.0.1:46711] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1923158660-172.31.14.131-1690157161479 (Datanode Uuid d12f50a7-c1e7-42bf-bfec-2ec6af50f38e) service to localhost/127.0.0.1:46711 2023-07-24 00:08:57,730 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data1/current/BP-1923158660-172.31.14.131-1690157161479] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 00:08:57,730 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ea6da739-0cc9-775e-e222-ab8a6b4451b3/cluster_4110819d-a97e-49af-384e-2de627408bf9/dfs/data/data2/current/BP-1923158660-172.31.14.131-1690157161479] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 00:08:57,753 INFO [Listener at jenkins-hbase4.apache.org/43137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 00:08:57,878 INFO [Listener at jenkins-hbase4.apache.org/43137] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 00:08:57,971 INFO [Listener at jenkins-hbase4.apache.org/43137] hbase.HBaseTestingUtility(1293): Minicluster is down