2023-10-05 20:59:54,860 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-05 20:59:55,064 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409 2023-10-05 20:59:55,064 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-05 20:59:55,064 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-05 20:59:55,099 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-05 20:59:55,324 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-05 20:59:55,325 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81, deleteOnExit=true 2023-10-05 20:59:55,325 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-05 20:59:55,325 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/test.cache.data in system properties and HBase conf 2023-10-05 20:59:55,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 20:59:55,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop.log.dir in system properties and HBase conf 2023-10-05 20:59:55,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 20:59:55,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 20:59:55,327 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 20:59:55,590 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-05 20:59:55,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 20:59:55,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 20:59:55,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 20:59:55,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 20:59:55,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 20:59:55,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 20:59:55,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 20:59:55,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 20:59:55,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 20:59:55,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/nfs.dump.dir in system properties and HBase conf 2023-10-05 20:59:55,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir in system properties and HBase conf 2023-10-05 20:59:55,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 20:59:55,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 20:59:55,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-05 20:59:56,098 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 20:59:56,102 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 20:59:56,368 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-05 20:59:56,522 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-05 20:59:56,534 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:59:56,565 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:59:56,596 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_localhost_45255_hdfs____.rutqud/webapp 2023-10-05 20:59:56,727 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45255 2023-10-05 20:59:56,783 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 20:59:56,783 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 20:59:57,236 WARN [Listener at localhost/43021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 20:59:57,300 WARN [Listener at localhost/43021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 20:59:57,324 WARN [Listener at localhost/43021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:59:57,331 INFO [Listener at localhost/43021] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:59:57,335 INFO [Listener at localhost/43021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_localhost_38051_datanode____im6rhq/webapp 2023-10-05 20:59:57,441 INFO [Listener at localhost/43021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38051 2023-10-05 20:59:57,802 WARN [Listener at localhost/38649] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 20:59:57,815 WARN [Listener at localhost/38649] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 20:59:57,821 WARN [Listener at localhost/38649] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:59:57,823 INFO [Listener at localhost/38649] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:59:57,827 INFO [Listener at localhost/38649] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_localhost_39497_datanode____.noqwvh/webapp 2023-10-05 20:59:57,930 INFO [Listener at localhost/38649] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39497 2023-10-05 20:59:57,943 WARN [Listener at localhost/38939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 20:59:57,963 WARN [Listener at localhost/38939] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 20:59:57,966 WARN [Listener at localhost/38939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:59:57,967 INFO [Listener at localhost/38939] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:59:57,973 INFO [Listener at localhost/38939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_localhost_45985_datanode____x4qofw/webapp 2023-10-05 20:59:58,088 INFO [Listener at localhost/38939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45985 2023-10-05 20:59:58,101 WARN [Listener at localhost/44419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 20:59:58,308 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdad013e2a1fc3f21: Processing first storage report for DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f from datanode e8db1d55-aa60-48e8-b5c7-4942dac7b718 2023-10-05 20:59:58,309 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdad013e2a1fc3f21: from storage DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f node DatanodeRegistration(127.0.0.1:34399, datanodeUuid=e8db1d55-aa60-48e8-b5c7-4942dac7b718, infoPort=37709, infoSecurePort=0, ipcPort=38649, storageInfo=lv=-57;cid=testClusterID;nsid=2014364209;c=1696539596170), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x871a3e8d8ff57a45: Processing first storage report for DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892 from datanode 54d6a243-704b-407f-b73d-4b7cbc495bc8 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x871a3e8d8ff57a45: from storage DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892 node DatanodeRegistration(127.0.0.1:37143, datanodeUuid=54d6a243-704b-407f-b73d-4b7cbc495bc8, infoPort=38525, infoSecurePort=0, ipcPort=44419, storageInfo=lv=-57;cid=testClusterID;nsid=2014364209;c=1696539596170), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d79575cd32c64ea: Processing first storage report for DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf from datanode 2947d646-253f-44fe-aa83-e4427667c081 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d79575cd32c64ea: from storage DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf node DatanodeRegistration(127.0.0.1:38171, datanodeUuid=2947d646-253f-44fe-aa83-e4427667c081, infoPort=35949, infoSecurePort=0, ipcPort=38939, storageInfo=lv=-57;cid=testClusterID;nsid=2014364209;c=1696539596170), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdad013e2a1fc3f21: Processing first storage report for DS-4794749c-4ec2-4e99-a25d-e97d09752d9a from datanode e8db1d55-aa60-48e8-b5c7-4942dac7b718 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdad013e2a1fc3f21: from storage DS-4794749c-4ec2-4e99-a25d-e97d09752d9a node DatanodeRegistration(127.0.0.1:34399, datanodeUuid=e8db1d55-aa60-48e8-b5c7-4942dac7b718, infoPort=37709, infoSecurePort=0, ipcPort=38649, storageInfo=lv=-57;cid=testClusterID;nsid=2014364209;c=1696539596170), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 20:59:58,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x871a3e8d8ff57a45: Processing first storage report for DS-8310cf3a-abff-4548-839c-a7b6e1af9620 from datanode 54d6a243-704b-407f-b73d-4b7cbc495bc8 2023-10-05 20:59:58,311 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x871a3e8d8ff57a45: from storage DS-8310cf3a-abff-4548-839c-a7b6e1af9620 node DatanodeRegistration(127.0.0.1:37143, datanodeUuid=54d6a243-704b-407f-b73d-4b7cbc495bc8, infoPort=38525, infoSecurePort=0, ipcPort=44419, storageInfo=lv=-57;cid=testClusterID;nsid=2014364209;c=1696539596170), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 20:59:58,311 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d79575cd32c64ea: Processing first storage report for DS-a253522d-8d3b-4be3-8b73-a40600fbc1be from datanode 2947d646-253f-44fe-aa83-e4427667c081 2023-10-05 20:59:58,311 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d79575cd32c64ea: from storage DS-a253522d-8d3b-4be3-8b73-a40600fbc1be node DatanodeRegistration(127.0.0.1:38171, datanodeUuid=2947d646-253f-44fe-aa83-e4427667c081, infoPort=35949, infoSecurePort=0, ipcPort=38939, storageInfo=lv=-57;cid=testClusterID;nsid=2014364209;c=1696539596170), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 20:59:58,476 DEBUG [Listener at localhost/44419] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409 2023-10-05 20:59:58,554 INFO [Listener at localhost/44419] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/zookeeper_0, clientPort=54534, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-05 20:59:58,571 INFO [Listener at localhost/44419] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54534 2023-10-05 20:59:58,582 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 20:59:58,584 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 20:59:59,281 INFO [Listener at localhost/44419] util.FSUtils(471): Created version file at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d with version=8 2023-10-05 20:59:59,282 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/hbase-staging 2023-10-05 20:59:59,633 INFO [Listener at localhost/44419] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-05 21:00:00,156 INFO [Listener at localhost/44419] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 21:00:00,189 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,190 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,190 INFO [Listener at localhost/44419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 21:00:00,190 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,191 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 21:00:00,332 INFO [Listener at localhost/44419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 21:00:00,404 DEBUG [Listener at localhost/44419] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-05 21:00:00,498 INFO [Listener at localhost/44419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33411 2023-10-05 21:00:00,511 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,513 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,539 INFO [Listener at localhost/44419] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33411 connecting to ZooKeeper ensemble=127.0.0.1:54534 2023-10-05 21:00:00,586 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:334110x0, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 21:00:00,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33411-0x1011863166d0000 connected 2023-10-05 21:00:00,618 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 21:00:00,619 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:00:00,632 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 21:00:00,639 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33411 2023-10-05 21:00:00,640 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33411 2023-10-05 21:00:00,640 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33411 2023-10-05 21:00:00,641 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33411 2023-10-05 21:00:00,641 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33411 2023-10-05 21:00:00,647 INFO [Listener at localhost/44419] master.HMaster(444): hbase.rootdir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, hbase.cluster.distributed=false 2023-10-05 21:00:00,708 INFO [Listener at localhost/44419] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 21:00:00,709 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,709 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,709 INFO [Listener at localhost/44419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 21:00:00,709 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,709 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 21:00:00,714 INFO [Listener at localhost/44419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 21:00:00,716 INFO [Listener at localhost/44419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37883 2023-10-05 21:00:00,719 INFO [Listener at localhost/44419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 21:00:00,725 INFO [Listener at localhost/44419] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 21:00:00,727 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,728 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,731 INFO [Listener at localhost/44419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37883 connecting to ZooKeeper ensemble=127.0.0.1:54534 2023-10-05 21:00:00,736 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:378830x0, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 21:00:00,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37883-0x1011863166d0001 connected 2023-10-05 21:00:00,737 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 21:00:00,738 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:00:00,739 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 21:00:00,740 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37883 2023-10-05 21:00:00,741 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37883 2023-10-05 21:00:00,741 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37883 2023-10-05 21:00:00,742 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37883 2023-10-05 21:00:00,742 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37883 2023-10-05 21:00:00,754 INFO [Listener at localhost/44419] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 21:00:00,754 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,754 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,755 INFO [Listener at localhost/44419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 21:00:00,755 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,755 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 21:00:00,755 INFO [Listener at localhost/44419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 21:00:00,758 INFO [Listener at localhost/44419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34111 2023-10-05 21:00:00,758 INFO [Listener at localhost/44419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 21:00:00,759 INFO [Listener at localhost/44419] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 21:00:00,760 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,763 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,766 INFO [Listener at localhost/44419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34111 connecting to ZooKeeper ensemble=127.0.0.1:54534 2023-10-05 21:00:00,769 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:341110x0, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 21:00:00,770 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:341110x0, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 21:00:00,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34111-0x1011863166d0002 connected 2023-10-05 21:00:00,771 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:00:00,772 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 21:00:00,772 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34111 2023-10-05 21:00:00,777 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34111 2023-10-05 21:00:00,777 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34111 2023-10-05 21:00:00,781 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34111 2023-10-05 21:00:00,781 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34111 2023-10-05 21:00:00,794 INFO [Listener at localhost/44419] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 21:00:00,794 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,794 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,794 INFO [Listener at localhost/44419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 21:00:00,794 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 21:00:00,795 INFO [Listener at localhost/44419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 21:00:00,795 INFO [Listener at localhost/44419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 21:00:00,796 INFO [Listener at localhost/44419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35295 2023-10-05 21:00:00,796 INFO [Listener at localhost/44419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 21:00:00,797 INFO [Listener at localhost/44419] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 21:00:00,798 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,799 INFO [Listener at localhost/44419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:00,801 INFO [Listener at localhost/44419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35295 connecting to ZooKeeper ensemble=127.0.0.1:54534 2023-10-05 21:00:00,804 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:352950x0, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 21:00:00,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35295-0x1011863166d0003 connected 2023-10-05 21:00:00,805 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 21:00:00,806 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:00:00,807 DEBUG [Listener at localhost/44419] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 21:00:00,808 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35295 2023-10-05 21:00:00,809 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35295 2023-10-05 21:00:00,809 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35295 2023-10-05 21:00:00,809 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35295 2023-10-05 21:00:00,813 DEBUG [Listener at localhost/44419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35295 2023-10-05 21:00:00,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:00,823 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 21:00:00,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:00,843 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 21:00:00,843 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 21:00:00,843 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 21:00:00,843 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 21:00:00,844 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:00,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 21:00:00,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33411,1696539599455 from backup master directory 2023-10-05 21:00:00,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 21:00:00,851 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:00,851 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 21:00:00,852 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 21:00:00,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:00,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-05 21:00:00,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-05 21:00:00,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/hbase.id with ID: d6b3cf5e-b790-444d-9951-bd63e55c879d 2023-10-05 21:00:00,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 21:00:01,009 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:01,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4e636e72 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:01,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d9e0feb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:01,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 21:00:01,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-05 21:00:01,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-05 21:00:01,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-05 21:00:01,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 21:00:01,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 21:00:01,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 21:00:01,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store-tmp 2023-10-05 21:00:01,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:01,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 21:00:01,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:00:01,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:00:01,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 21:00:01,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:00:01,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:00:01,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 21:00:01,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/WALs/jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:01,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33411%2C1696539599455, suffix=, logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/WALs/jenkins-hbase4.apache.org,33411,1696539599455, archiveDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/oldWALs, maxLogs=10 2023-10-05 21:00:01,312 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK] 2023-10-05 21:00:01,312 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK] 2023-10-05 21:00:01,312 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK] 2023-10-05 21:00:01,320 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-05 21:00:01,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/WALs/jenkins-hbase4.apache.org,33411,1696539599455/jenkins-hbase4.apache.org%2C33411%2C1696539599455.1696539601259 2023-10-05 21:00:01,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK], DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK], DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK]] 2023-10-05 21:00:01,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-05 21:00:01,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:01,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 21:00:01,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 21:00:01,472 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-05 21:00:01,478 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-05 21:00:01,507 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-05 21:00:01,519 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:01,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 21:00:01,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 21:00:01,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 21:00:01,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:01,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68383640, jitterRate=0.01899564266204834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:01,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 21:00:01,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-05 21:00:01,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-05 21:00:01,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-05 21:00:01,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-05 21:00:01,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-05 21:00:01,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 52 msec 2023-10-05 21:00:01,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-05 21:00:01,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-05 21:00:01,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-05 21:00:01,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-05 21:00:01,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-05 21:00:01,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-05 21:00:01,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-05 21:00:01,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-05 21:00:01,719 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:01,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-05 21:00:01,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-05 21:00:01,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-05 21:00:01,748 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 21:00:01,748 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 21:00:01,748 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 21:00:01,748 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 21:00:01,748 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:01,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33411,1696539599455, sessionid=0x1011863166d0000, setting cluster-up flag (Was=false) 2023-10-05 21:00:01,776 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:01,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-05 21:00:01,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:01,805 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:01,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-05 21:00:01,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:01,820 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp 2023-10-05 21:00:01,917 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(951): ClusterId : d6b3cf5e-b790-444d-9951-bd63e55c879d 2023-10-05 21:00:01,918 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(951): ClusterId : d6b3cf5e-b790-444d-9951-bd63e55c879d 2023-10-05 21:00:01,918 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(951): ClusterId : d6b3cf5e-b790-444d-9951-bd63e55c879d 2023-10-05 21:00:01,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-05 21:00:01,925 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 21:00:01,925 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 21:00:01,925 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 21:00:01,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:01,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-05 21:00:01,934 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 21:00:01,934 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 21:00:01,934 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 21:00:01,934 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 21:00:01,934 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 21:00:01,934 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 21:00:01,940 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 21:00:01,943 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 21:00:01,943 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 21:00:01,951 DEBUG [RS:1;jenkins-hbase4:34111] zookeeper.ReadOnlyZKClient(139): Connect 0x17400987 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:01,952 DEBUG [RS:0;jenkins-hbase4:37883] zookeeper.ReadOnlyZKClient(139): Connect 0x288326de to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:01,952 DEBUG [RS:2;jenkins-hbase4:35295] zookeeper.ReadOnlyZKClient(139): Connect 0x42baac64 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:01,962 DEBUG [RS:1;jenkins-hbase4:34111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10e6eb15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:01,963 DEBUG [RS:1;jenkins-hbase4:34111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ba9168, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 21:00:02,017 DEBUG [RS:2;jenkins-hbase4:35295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33137bec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:02,018 DEBUG [RS:0;jenkins-hbase4:37883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4926f6fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:02,018 DEBUG [RS:2;jenkins-hbase4:35295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a18d4c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 21:00:02,019 DEBUG [RS:0;jenkins-hbase4:37883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28329a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 21:00:02,031 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35295 2023-10-05 21:00:02,034 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37883 2023-10-05 21:00:02,036 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34111 2023-10-05 21:00:02,037 INFO [RS:0;jenkins-hbase4:37883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 21:00:02,037 INFO [RS:1;jenkins-hbase4:34111] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 21:00:02,038 INFO [RS:1;jenkins-hbase4:34111] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 21:00:02,037 INFO [RS:2;jenkins-hbase4:35295] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 21:00:02,038 INFO [RS:2;jenkins-hbase4:35295] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 21:00:02,038 INFO [RS:0;jenkins-hbase4:37883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 21:00:02,039 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 21:00:02,039 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 21:00:02,039 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 21:00:02,039 INFO [RS:2;jenkins-hbase4:35295] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:02,040 INFO [RS:1;jenkins-hbase4:34111] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:02,040 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 21:00:02,040 INFO [RS:0;jenkins-hbase4:37883] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:02,040 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 21:00:02,040 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 21:00:02,043 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33411,1696539599455 with isa=jenkins-hbase4.apache.org/172.31.14.131:35295, startcode=1696539600793 2023-10-05 21:00:02,043 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33411,1696539599455 with isa=jenkins-hbase4.apache.org/172.31.14.131:37883, startcode=1696539600708 2023-10-05 21:00:02,043 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33411,1696539599455 with isa=jenkins-hbase4.apache.org/172.31.14.131:34111, startcode=1696539600754 2023-10-05 21:00:02,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-05 21:00:02,061 DEBUG [RS:0;jenkins-hbase4:37883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 21:00:02,061 DEBUG [RS:1;jenkins-hbase4:34111] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 21:00:02,061 DEBUG [RS:2;jenkins-hbase4:35295] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 21:00:02,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 21:00:02,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 21:00:02,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 21:00:02,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 21:00:02,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-05 21:00:02,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 21:00:02,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696539632065 2023-10-05 21:00:02,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-05 21:00:02,074 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 21:00:02,075 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-05 21:00:02,081 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 21:00:02,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-05 21:00:02,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-05 21:00:02,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-05 21:00:02,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-05 21:00:02,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-05 21:00:02,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-05 21:00:02,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-05 21:00:02,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-05 21:00:02,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-05 21:00:02,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-05 21:00:02,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696539602113,5,FailOnTimeoutGroup] 2023-10-05 21:00:02,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696539602117,5,FailOnTimeoutGroup] 2023-10-05 21:00:02,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-05 21:00:02,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,130 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37575, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 21:00:02,130 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44753, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 21:00:02,130 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32779, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 21:00:02,151 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33411] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,155 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:02,156 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:02,157 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:02,166 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33411] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,168 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33411] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,175 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:02,175 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:02,175 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:02,177 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43021 2023-10-05 21:00:02,176 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43021 2023-10-05 21:00:02,177 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 21:00:02,177 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43021 2023-10-05 21:00:02,177 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 21:00:02,177 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 21:00:02,190 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 21:00:02,191 DEBUG [RS:1;jenkins-hbase4:34111] zookeeper.ZKUtil(162): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,192 DEBUG [RS:0;jenkins-hbase4:37883] zookeeper.ZKUtil(162): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,192 DEBUG [RS:2;jenkins-hbase4:35295] zookeeper.ZKUtil(162): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,192 WARN [RS:1;jenkins-hbase4:34111] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 21:00:02,192 INFO [RS:1;jenkins-hbase4:34111] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 21:00:02,192 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,192 WARN [RS:0;jenkins-hbase4:37883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 21:00:02,192 WARN [RS:2;jenkins-hbase4:35295] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 21:00:02,193 INFO [RS:0;jenkins-hbase4:37883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 21:00:02,194 INFO [RS:2;jenkins-hbase4:35295] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 21:00:02,195 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,195 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,201 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35295,1696539600793] 2023-10-05 21:00:02,201 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34111,1696539600754] 2023-10-05 21:00:02,201 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37883,1696539600708] 2023-10-05 21:00:02,202 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:02,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 21:00:02,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/info 2023-10-05 21:00:02,210 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 21:00:02,210 DEBUG [RS:0;jenkins-hbase4:37883] zookeeper.ZKUtil(162): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,211 DEBUG [RS:2;jenkins-hbase4:35295] zookeeper.ZKUtil(162): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,210 DEBUG [RS:1;jenkins-hbase4:34111] zookeeper.ZKUtil(162): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:02,211 DEBUG [RS:0;jenkins-hbase4:37883] zookeeper.ZKUtil(162): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,211 DEBUG [RS:2;jenkins-hbase4:35295] zookeeper.ZKUtil(162): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,212 DEBUG [RS:1;jenkins-hbase4:34111] zookeeper.ZKUtil(162): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,212 DEBUG [RS:0;jenkins-hbase4:37883] zookeeper.ZKUtil(162): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,212 DEBUG [RS:1;jenkins-hbase4:34111] zookeeper.ZKUtil(162): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,212 DEBUG [RS:2;jenkins-hbase4:35295] zookeeper.ZKUtil(162): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 21:00:02,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/rep_barrier 2023-10-05 21:00:02,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 21:00:02,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:02,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 21:00:02,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/table 2023-10-05 21:00:02,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 21:00:02,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:02,227 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 21:00:02,229 DEBUG [RS:0;jenkins-hbase4:37883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 21:00:02,227 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 21:00:02,228 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740 2023-10-05 21:00:02,234 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740 2023-10-05 21:00:02,240 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 21:00:02,243 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 21:00:02,245 INFO [RS:2;jenkins-hbase4:35295] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 21:00:02,246 INFO [RS:0;jenkins-hbase4:37883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 21:00:02,246 INFO [RS:1;jenkins-hbase4:34111] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 21:00:02,247 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:02,248 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62239329, jitterRate=-0.07256172597408295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 21:00:02,248 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 21:00:02,248 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 21:00:02,248 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 21:00:02,248 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 21:00:02,248 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 21:00:02,248 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 21:00:02,250 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 21:00:02,250 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 21:00:02,257 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 21:00:02,257 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-05 21:00:02,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-05 21:00:02,275 INFO [RS:1;jenkins-hbase4:34111] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 21:00:02,277 INFO [RS:2;jenkins-hbase4:35295] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 21:00:02,279 INFO [RS:0;jenkins-hbase4:37883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 21:00:02,284 INFO [RS:0;jenkins-hbase4:37883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 21:00:02,284 INFO [RS:1;jenkins-hbase4:34111] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 21:00:02,285 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-05 21:00:02,284 INFO [RS:2;jenkins-hbase4:35295] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 21:00:02,286 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,285 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,286 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,287 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 21:00:02,287 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 21:00:02,287 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 21:00:02,290 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-05 21:00:02,298 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,298 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,298 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,298 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,298 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 21:00:02,300 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 21:00:02,300 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:1;jenkins-hbase4:34111] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,299 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:0;jenkins-hbase4:37883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,300 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,301 DEBUG [RS:2;jenkins-hbase4:35295] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 21:00:02,304 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,305 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,305 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,309 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,309 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,309 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,311 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,311 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,311 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,321 INFO [RS:1;jenkins-hbase4:34111] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 21:00:02,324 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34111,1696539600754-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,326 INFO [RS:2;jenkins-hbase4:35295] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 21:00:02,327 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35295,1696539600793-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,333 INFO [RS:0;jenkins-hbase4:37883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 21:00:02,333 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37883,1696539600708-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,353 INFO [RS:2;jenkins-hbase4:35295] regionserver.Replication(203): jenkins-hbase4.apache.org,35295,1696539600793 started 2023-10-05 21:00:02,353 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35295,1696539600793, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35295, sessionid=0x1011863166d0003 2023-10-05 21:00:02,357 INFO [RS:1;jenkins-hbase4:34111] regionserver.Replication(203): jenkins-hbase4.apache.org,34111,1696539600754 started 2023-10-05 21:00:02,357 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 21:00:02,357 INFO [RS:0;jenkins-hbase4:37883] regionserver.Replication(203): jenkins-hbase4.apache.org,37883,1696539600708 started 2023-10-05 21:00:02,357 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34111,1696539600754, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34111, sessionid=0x1011863166d0002 2023-10-05 21:00:02,357 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37883,1696539600708, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37883, sessionid=0x1011863166d0001 2023-10-05 21:00:02,357 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 21:00:02,357 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 21:00:02,358 DEBUG [RS:0;jenkins-hbase4:37883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,357 DEBUG [RS:2;jenkins-hbase4:35295] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,358 DEBUG [RS:0;jenkins-hbase4:37883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37883,1696539600708' 2023-10-05 21:00:02,357 DEBUG [RS:1;jenkins-hbase4:34111] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,359 DEBUG [RS:0;jenkins-hbase4:37883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 21:00:02,358 DEBUG [RS:2;jenkins-hbase4:35295] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35295,1696539600793' 2023-10-05 21:00:02,359 DEBUG [RS:1;jenkins-hbase4:34111] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34111,1696539600754' 2023-10-05 21:00:02,359 DEBUG [RS:1;jenkins-hbase4:34111] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 21:00:02,359 DEBUG [RS:2;jenkins-hbase4:35295] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 21:00:02,360 DEBUG [RS:0;jenkins-hbase4:37883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 21:00:02,360 DEBUG [RS:1;jenkins-hbase4:34111] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 21:00:02,360 DEBUG [RS:2;jenkins-hbase4:35295] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 21:00:02,361 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 21:00:02,361 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 21:00:02,361 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 21:00:02,361 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 21:00:02,361 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 21:00:02,361 DEBUG [RS:0;jenkins-hbase4:37883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:02,361 DEBUG [RS:2;jenkins-hbase4:35295] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,361 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 21:00:02,362 DEBUG [RS:2;jenkins-hbase4:35295] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35295,1696539600793' 2023-10-05 21:00:02,362 DEBUG [RS:2;jenkins-hbase4:35295] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:02,362 DEBUG [RS:0;jenkins-hbase4:37883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37883,1696539600708' 2023-10-05 21:00:02,362 DEBUG [RS:0;jenkins-hbase4:37883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:02,362 DEBUG [RS:1;jenkins-hbase4:34111] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:02,363 DEBUG [RS:1;jenkins-hbase4:34111] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34111,1696539600754' 2023-10-05 21:00:02,363 DEBUG [RS:1;jenkins-hbase4:34111] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:02,363 DEBUG [RS:0;jenkins-hbase4:37883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:02,363 DEBUG [RS:1;jenkins-hbase4:34111] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:02,363 DEBUG [RS:2;jenkins-hbase4:35295] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:02,364 DEBUG [RS:0;jenkins-hbase4:37883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 21:00:02,364 DEBUG [RS:1;jenkins-hbase4:34111] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 21:00:02,364 INFO [RS:1;jenkins-hbase4:34111] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 21:00:02,364 INFO [RS:0;jenkins-hbase4:37883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 21:00:02,365 INFO [RS:1;jenkins-hbase4:34111] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 21:00:02,364 DEBUG [RS:2;jenkins-hbase4:35295] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 21:00:02,365 INFO [RS:0;jenkins-hbase4:37883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 21:00:02,366 INFO [RS:2;jenkins-hbase4:35295] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 21:00:02,366 INFO [RS:2;jenkins-hbase4:35295] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 21:00:02,443 DEBUG [jenkins-hbase4:33411] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-05 21:00:02,449 DEBUG [jenkins-hbase4:33411] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:00:02,456 DEBUG [jenkins-hbase4:33411] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:00:02,456 DEBUG [jenkins-hbase4:33411] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:00:02,456 DEBUG [jenkins-hbase4:33411] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:00:02,456 DEBUG [jenkins-hbase4:33411] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:00:02,459 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35295,1696539600793, state=OPENING 2023-10-05 21:00:02,466 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-05 21:00:02,468 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:02,469 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 21:00:02,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:00:02,482 INFO [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35295%2C1696539600793, suffix=, logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,35295,1696539600793, archiveDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs, maxLogs=32 2023-10-05 21:00:02,482 INFO [RS:0;jenkins-hbase4:37883] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37883%2C1696539600708, suffix=, logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,37883,1696539600708, archiveDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs, maxLogs=32 2023-10-05 21:00:02,482 INFO [RS:1;jenkins-hbase4:34111] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34111%2C1696539600754, suffix=, logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,34111,1696539600754, archiveDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs, maxLogs=32 2023-10-05 21:00:02,538 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK] 2023-10-05 21:00:02,538 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK] 2023-10-05 21:00:02,538 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK] 2023-10-05 21:00:02,539 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK] 2023-10-05 21:00:02,539 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK] 2023-10-05 21:00:02,539 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK] 2023-10-05 21:00:02,538 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK] 2023-10-05 21:00:02,540 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK] 2023-10-05 21:00:02,541 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK] 2023-10-05 21:00:02,558 INFO [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,35295,1696539600793/jenkins-hbase4.apache.org%2C35295%2C1696539600793.1696539602489 2023-10-05 21:00:02,558 INFO [RS:1;jenkins-hbase4:34111] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,34111,1696539600754/jenkins-hbase4.apache.org%2C34111%2C1696539600754.1696539602489 2023-10-05 21:00:02,558 INFO [RS:0;jenkins-hbase4:37883] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,37883,1696539600708/jenkins-hbase4.apache.org%2C37883%2C1696539600708.1696539602488 2023-10-05 21:00:02,558 DEBUG [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK], DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK], DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK]] 2023-10-05 21:00:02,558 DEBUG [RS:0;jenkins-hbase4:37883] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK], DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK], DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK]] 2023-10-05 21:00:02,559 DEBUG [RS:1;jenkins-hbase4:34111] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK], DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK], DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK]] 2023-10-05 21:00:02,664 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:02,666 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 21:00:02,669 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 21:00:02,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-05 21:00:02,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 21:00:02,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35295%2C1696539600793.meta, suffix=.meta, logDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,35295,1696539600793, archiveDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs, maxLogs=32 2023-10-05 21:00:02,712 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK] 2023-10-05 21:00:02,714 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK] 2023-10-05 21:00:02,715 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK] 2023-10-05 21:00:02,726 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/WALs/jenkins-hbase4.apache.org,35295,1696539600793/jenkins-hbase4.apache.org%2C35295%2C1696539600793.meta.1696539602692.meta 2023-10-05 21:00:02,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37143,DS-4cb9d8e6-f6f7-47fb-8032-3f2c696ca892,DISK], DatanodeInfoWithStorage[127.0.0.1:38171,DS-464142c7-7dbc-4755-8a3a-f7dcb73f17bf,DISK], DatanodeInfoWithStorage[127.0.0.1:34399,DS-f84acc0e-e15d-482d-a21a-b94dd8f1cc4f,DISK]] 2023-10-05 21:00:02,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-05 21:00:02,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-05 21:00:02,730 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:02,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-05 21:00:02,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-05 21:00:02,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-05 21:00:02,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-05 21:00:02,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:02,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-05 21:00:02,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-05 21:00:02,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 21:00:02,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/info 2023-10-05 21:00:02,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/info 2023-10-05 21:00:02,753 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 21:00:02,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:02,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 21:00:02,755 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/rep_barrier 2023-10-05 21:00:02,755 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/rep_barrier 2023-10-05 21:00:02,756 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 21:00:02,757 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:02,757 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 21:00:02,758 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/table 2023-10-05 21:00:02,758 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/table 2023-10-05 21:00:02,759 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 21:00:02,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:02,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740 2023-10-05 21:00:02,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740 2023-10-05 21:00:02,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 21:00:02,769 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 21:00:02,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66448169, jitterRate=-0.009845122694969177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 21:00:02,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 21:00:02,782 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696539602656 2023-10-05 21:00:02,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-05 21:00:02,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-05 21:00:02,804 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35295,1696539600793, state=OPEN 2023-10-05 21:00:02,807 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-05 21:00:02,807 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 21:00:02,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-05 21:00:02,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35295,1696539600793 in 333 msec 2023-10-05 21:00:02,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-05 21:00:02,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-10-05 21:00:02,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 886 msec 2023-10-05 21:00:02,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696539602826, completionTime=-1 2023-10-05 21:00:02,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-05 21:00:02,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-05 21:00:02,909 DEBUG [hconnection-0x75c75c1c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:02,914 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:02,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-05 21:00:02,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696539662934 2023-10-05 21:00:02,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696539722935 2023-10-05 21:00:02,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 107 msec 2023-10-05 21:00:02,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33411,1696539599455-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33411,1696539599455-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33411,1696539599455-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33411, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-05 21:00:02,972 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-05 21:00:02,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-05 21:00:02,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 21:00:02,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-05 21:00:02,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:00:03,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:00:03,036 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,038 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53 empty. 2023-10-05 21:00:03,039 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-05 21:00:03,081 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:03,083 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 613243e6a94c0d50f018962d57f5fd53, NAME => 'hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:03,120 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:03,120 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 613243e6a94c0d50f018962d57f5fd53, disabling compactions & flushes 2023-10-05 21:00:03,120 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,120 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,120 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. after waiting 0 ms 2023-10-05 21:00:03,120 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,120 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 613243e6a94c0d50f018962d57f5fd53: 2023-10-05 21:00:03,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:00:03,145 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696539603129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539603129"}]},"ts":"1696539603129"} 2023-10-05 21:00:03,178 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 21:00:03,180 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:00:03,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539603180"}]},"ts":"1696539603180"} 2023-10-05 21:00:03,189 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-05 21:00:03,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:00:03,194 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:00:03,194 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:00:03,194 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:00:03,194 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:00:03,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=613243e6a94c0d50f018962d57f5fd53, ASSIGN}] 2023-10-05 21:00:03,200 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=613243e6a94c0d50f018962d57f5fd53, ASSIGN 2023-10-05 21:00:03,201 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=613243e6a94c0d50f018962d57f5fd53, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34111,1696539600754; forceNewPlan=false, retain=false 2023-10-05 21:00:03,354 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 21:00:03,355 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=613243e6a94c0d50f018962d57f5fd53, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:03,355 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696539603354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539603354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539603354"}]},"ts":"1696539603354"} 2023-10-05 21:00:03,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 613243e6a94c0d50f018962d57f5fd53, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:00:03,516 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:03,517 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 21:00:03,519 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 21:00:03,526 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 613243e6a94c0d50f018962d57f5fd53, NAME => 'hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.', STARTKEY => '', ENDKEY => ''} 2023-10-05 21:00:03,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. service=AccessControlService 2023-10-05 21:00:03,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:03,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:03,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,530 INFO [StoreOpener-613243e6a94c0d50f018962d57f5fd53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,532 DEBUG [StoreOpener-613243e6a94c0d50f018962d57f5fd53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/info 2023-10-05 21:00:03,532 DEBUG [StoreOpener-613243e6a94c0d50f018962d57f5fd53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/info 2023-10-05 21:00:03,533 INFO [StoreOpener-613243e6a94c0d50f018962d57f5fd53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 613243e6a94c0d50f018962d57f5fd53 columnFamilyName info 2023-10-05 21:00:03,534 INFO [StoreOpener-613243e6a94c0d50f018962d57f5fd53-1] regionserver.HStore(310): Store=613243e6a94c0d50f018962d57f5fd53/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:03,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:00:03,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:03,546 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 613243e6a94c0d50f018962d57f5fd53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64738937, jitterRate=-0.035314664244651794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:03,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 613243e6a94c0d50f018962d57f5fd53: 2023-10-05 21:00:03,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53., pid=6, masterSystemTime=1696539603516 2023-10-05 21:00:03,553 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,554 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:00:03,556 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=613243e6a94c0d50f018962d57f5fd53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:03,556 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696539603555"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539603555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539603555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539603555"}]},"ts":"1696539603555"} 2023-10-05 21:00:03,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-05 21:00:03,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 613243e6a94c0d50f018962d57f5fd53, server=jenkins-hbase4.apache.org,34111,1696539600754 in 198 msec 2023-10-05 21:00:03,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-05 21:00:03,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=613243e6a94c0d50f018962d57f5fd53, ASSIGN in 369 msec 2023-10-05 21:00:03,571 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:00:03,572 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539603571"}]},"ts":"1696539603571"} 2023-10-05 21:00:03,574 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-05 21:00:03,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:00:03,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 597 msec 2023-10-05 21:00:03,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-05 21:00:03,597 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-05 21:00:03,597 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:03,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:03,628 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:03,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-05 21:00:03,662 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 21:00:03,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-10-05 21:00:03,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-05 21:00:03,693 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 21:00:03,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-10-05 21:00:03,705 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-05 21:00:03,709 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-05 21:00:03,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.857sec 2023-10-05 21:00:03,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-05 21:00:03,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-05 21:00:03,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-05 21:00:03,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33411,1696539599455-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-05 21:00:03,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33411,1696539599455-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-05 21:00:03,723 DEBUG [Listener at localhost/44419] zookeeper.ReadOnlyZKClient(139): Connect 0x42c4a367 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:03,732 DEBUG [Listener at localhost/44419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322007f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:03,748 DEBUG [hconnection-0x61415aa9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:03,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 21:00:03,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-05 21:00:03,757 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:00:03,762 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:00:03,764 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:03,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-05 21:00:03,766 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:03,767 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91 empty. 2023-10-05 21:00:03,768 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:00:03,768 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-05 21:00:03,768 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/test.cache.data in system properties and HBase conf 2023-10-05 21:00:03,768 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 21:00:03,770 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop.log.dir in system properties and HBase conf 2023-10-05 21:00:03,770 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:03,770 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 21:00:03,770 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-05 21:00:03,770 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 21:00:03,770 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 21:00:03,770 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 21:00:03,770 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/nfs.dump.dir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir in system properties and HBase conf 2023-10-05 21:00:03,771 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 21:00:03,772 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 21:00:03,772 INFO [Listener at localhost/44419] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-05 21:00:03,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 21:00:03,804 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:03,806 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e0daea1c0daaf354f4392c12c612fe91, NAME => 'hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:03,852 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:03,852 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e0daea1c0daaf354f4392c12c612fe91, disabling compactions & flushes 2023-10-05 21:00:03,852 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:03,852 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:03,852 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. after waiting 0 ms 2023-10-05 21:00:03,852 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:03,852 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:03,852 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e0daea1c0daaf354f4392c12c612fe91: 2023-10-05 21:00:03,857 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:00:03,860 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696539603859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539603859"}]},"ts":"1696539603859"} 2023-10-05 21:00:03,865 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 21:00:03,868 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:00:03,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539603868"}]},"ts":"1696539603868"} 2023-10-05 21:00:03,871 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-05 21:00:03,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 21:00:03,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:00:03,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:00:03,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:00:03,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:00:03,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:00:03,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e0daea1c0daaf354f4392c12c612fe91, ASSIGN}] 2023-10-05 21:00:03,892 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e0daea1c0daaf354f4392c12c612fe91, ASSIGN 2023-10-05 21:00:03,894 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e0daea1c0daaf354f4392c12c612fe91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:00:04,044 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 21:00:04,045 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e0daea1c0daaf354f4392c12c612fe91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:04,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696539604045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539604045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539604045"}]},"ts":"1696539604045"} 2023-10-05 21:00:04,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e0daea1c0daaf354f4392c12c612fe91, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:00:04,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 21:00:04,214 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:04,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0daea1c0daaf354f4392c12c612fe91, NAME => 'hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.', STARTKEY => '', ENDKEY => ''} 2023-10-05 21:00:04,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. service=AccessControlService 2023-10-05 21:00:04,215 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:04,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:04,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,218 INFO [StoreOpener-e0daea1c0daaf354f4392c12c612fe91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,220 DEBUG [StoreOpener-e0daea1c0daaf354f4392c12c612fe91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/l 2023-10-05 21:00:04,220 DEBUG [StoreOpener-e0daea1c0daaf354f4392c12c612fe91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/l 2023-10-05 21:00:04,221 INFO [StoreOpener-e0daea1c0daaf354f4392c12c612fe91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0daea1c0daaf354f4392c12c612fe91 columnFamilyName l 2023-10-05 21:00:04,222 INFO [StoreOpener-e0daea1c0daaf354f4392c12c612fe91-1] regionserver.HStore(310): Store=e0daea1c0daaf354f4392c12c612fe91/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:04,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:00:04,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:04,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0daea1c0daaf354f4392c12c612fe91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65279990, jitterRate=-0.02725234627723694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:04,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0daea1c0daaf354f4392c12c612fe91: 2023-10-05 21:00:04,240 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91., pid=11, masterSystemTime=1696539604204 2023-10-05 21:00:04,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:04,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:00:04,244 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e0daea1c0daaf354f4392c12c612fe91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:04,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696539604244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539604244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539604244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539604244"}]},"ts":"1696539604244"} 2023-10-05 21:00:04,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-05 21:00:04,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e0daea1c0daaf354f4392c12c612fe91, server=jenkins-hbase4.apache.org,35295,1696539600793 in 199 msec 2023-10-05 21:00:04,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-05 21:00:04,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e0daea1c0daaf354f4392c12c612fe91, ASSIGN in 368 msec 2023-10-05 21:00:04,263 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:00:04,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539604263"}]},"ts":"1696539604263"} 2023-10-05 21:00:04,266 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-05 21:00:04,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:00:04,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 519 msec 2023-10-05 21:00:04,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 21:00:04,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-05 21:00:04,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-05 21:00:04,941 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 21:00:05,235 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 21:00:05,240 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33621_jobhistory____i6efwe/webapp 2023-10-05 21:00:05,396 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-05 21:00:05,396 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-05 21:00:05,396 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 21:00:05,399 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 21:00:05,461 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:05,733 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:06,058 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-05 21:00:06,089 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33621 2023-10-05 21:00:06,433 WARN [Listener at jenkins-hbase4.apache.org/37145] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 21:00:06,701 WARN [Listener at jenkins-hbase4.apache.org/37145] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 21:00:06,705 INFO [Listener at jenkins-hbase4.apache.org/37145] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 21:00:06,713 INFO [Listener at jenkins-hbase4.apache.org/37145] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34825_cluster____93h2wa/webapp 2023-10-05 21:00:06,780 INFO [Listener at jenkins-hbase4.apache.org/37145] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 21:00:06,781 INFO [Listener at jenkins-hbase4.apache.org/37145] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-05 21:00:06,781 INFO [Listener at jenkins-hbase4.apache.org/37145] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 21:00:06,781 INFO [Listener at jenkins-hbase4.apache.org/37145] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 21:00:06,789 INFO [Listener at jenkins-hbase4.apache.org/37145] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:06,991 INFO [Listener at jenkins-hbase4.apache.org/37145] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:07,113 INFO [Listener at jenkins-hbase4.apache.org/37145] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:07,122 INFO [Listener at jenkins-hbase4.apache.org/37145] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34825 2023-10-05 21:00:07,637 WARN [Listener at jenkins-hbase4.apache.org/37149] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 21:00:07,659 WARN [Listener at jenkins-hbase4.apache.org/37149] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 21:00:07,659 INFO [Listener at jenkins-hbase4.apache.org/37149] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 21:00:07,664 INFO [Listener at jenkins-hbase4.apache.org/37149] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34915_node____.4s5hnq/webapp 2023-10-05 21:00:07,715 INFO [Listener at jenkins-hbase4.apache.org/37149] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 21:00:07,715 INFO [Listener at jenkins-hbase4.apache.org/37149] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 21:00:07,715 INFO [Listener at jenkins-hbase4.apache.org/37149] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 21:00:07,715 INFO [Listener at jenkins-hbase4.apache.org/37149] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 21:00:07,723 INFO [Listener at jenkins-hbase4.apache.org/37149] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:07,742 INFO [Listener at jenkins-hbase4.apache.org/37149] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:07,870 INFO [Listener at jenkins-hbase4.apache.org/37149] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:07,882 INFO [Listener at jenkins-hbase4.apache.org/37149] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34915 2023-10-05 21:00:08,078 WARN [Listener at jenkins-hbase4.apache.org/40083] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 21:00:08,087 WARN [Listener at jenkins-hbase4.apache.org/40083] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 21:00:08,087 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 21:00:08,095 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33711_node____u0xlrp/webapp 2023-10-05 21:00:08,165 INFO [Listener at jenkins-hbase4.apache.org/40083] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 21:00:08,165 INFO [Listener at jenkins-hbase4.apache.org/40083] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 21:00:08,165 INFO [Listener at jenkins-hbase4.apache.org/40083] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 21:00:08,165 INFO [Listener at jenkins-hbase4.apache.org/40083] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 21:00:08,172 INFO [Listener at jenkins-hbase4.apache.org/40083] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:08,183 INFO [Listener at jenkins-hbase4.apache.org/40083] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:08,240 INFO [Listener at jenkins-hbase4.apache.org/40083] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 21:00:08,245 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33711 2023-10-05 21:00:08,267 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-05 21:00:08,268 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:08,318 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:00:08,335 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=169, AvailableMemoryMB=6831 2023-10-05 21:00:08,335 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-10-05 21:00:08,361 DEBUG [Listener at jenkins-hbase4.apache.org/40083] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-05 21:00:08,367 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-05 21:00:08,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 21:00:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:08,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:00:08,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-05 21:00:08,398 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:00:08,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 21:00:08,405 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,415 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 empty. 2023-10-05 21:00:08,415 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,417 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,418 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 empty. 2023-10-05 21:00:08,422 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,422 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 21:00:08,486 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:08,491 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => d1ac4142746e8a744fd46bcfaeb1d6f7, NAME => 'testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:08,492 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e5a463a33d6b9653cb222327c1213dc1, NAME => 'testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:08,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 21:00:08,523 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-05 21:00:08,527 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-05 21:00:08,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-05 21:00:08,555 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:08,555 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e5a463a33d6b9653cb222327c1213dc1, disabling compactions & flushes 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing d1ac4142746e8a744fd46bcfaeb1d6f7, disabling compactions & flushes 2023-10-05 21:00:08,556 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,556 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. after waiting 0 ms 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. after waiting 0 ms 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,556 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,556 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e5a463a33d6b9653cb222327c1213dc1: 2023-10-05 21:00:08,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for d1ac4142746e8a744fd46bcfaeb1d6f7: 2023-10-05 21:00:08,560 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:00:08,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539608561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539608561"}]},"ts":"1696539608561"} 2023-10-05 21:00:08,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539608561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539608561"}]},"ts":"1696539608561"} 2023-10-05 21:00:08,614 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:00:08,616 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:00:08,616 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539608616"}]},"ts":"1696539608616"} 2023-10-05 21:00:08,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-05 21:00:08,623 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:00:08,625 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:00:08,625 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:00:08,625 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:00:08,625 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:00:08,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, ASSIGN}] 2023-10-05 21:00:08,628 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, ASSIGN 2023-10-05 21:00:08,628 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, ASSIGN 2023-10-05 21:00:08,630 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34111,1696539600754; forceNewPlan=false, retain=false 2023-10-05 21:00:08,630 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:00:08,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 21:00:08,780 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:00:08,783 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e5a463a33d6b9653cb222327c1213dc1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:08,783 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d1ac4142746e8a744fd46bcfaeb1d6f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:08,783 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539608783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539608783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539608783"}]},"ts":"1696539608783"} 2023-10-05 21:00:08,784 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539608783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539608783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539608783"}]},"ts":"1696539608783"} 2023-10-05 21:00:08,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure e5a463a33d6b9653cb222327c1213dc1, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:00:08,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure d1ac4142746e8a744fd46bcfaeb1d6f7, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:00:08,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1ac4142746e8a744fd46bcfaeb1d6f7, NAME => 'testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 21:00:08,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. service=AccessControlService 2023-10-05 21:00:08,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:08,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:08,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5a463a33d6b9653cb222327c1213dc1, NAME => 'testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 21:00:08,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. service=AccessControlService 2023-10-05 21:00:08,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:08,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:08,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,952 INFO [StoreOpener-d1ac4142746e8a744fd46bcfaeb1d6f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,952 INFO [StoreOpener-e5a463a33d6b9653cb222327c1213dc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,954 DEBUG [StoreOpener-d1ac4142746e8a744fd46bcfaeb1d6f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf 2023-10-05 21:00:08,954 DEBUG [StoreOpener-d1ac4142746e8a744fd46bcfaeb1d6f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf 2023-10-05 21:00:08,954 DEBUG [StoreOpener-e5a463a33d6b9653cb222327c1213dc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf 2023-10-05 21:00:08,954 DEBUG [StoreOpener-e5a463a33d6b9653cb222327c1213dc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf 2023-10-05 21:00:08,958 INFO [StoreOpener-e5a463a33d6b9653cb222327c1213dc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5a463a33d6b9653cb222327c1213dc1 columnFamilyName cf 2023-10-05 21:00:08,958 INFO [StoreOpener-d1ac4142746e8a744fd46bcfaeb1d6f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1ac4142746e8a744fd46bcfaeb1d6f7 columnFamilyName cf 2023-10-05 21:00:08,961 INFO [StoreOpener-d1ac4142746e8a744fd46bcfaeb1d6f7-1] regionserver.HStore(310): Store=d1ac4142746e8a744fd46bcfaeb1d6f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:08,961 INFO [StoreOpener-e5a463a33d6b9653cb222327c1213dc1-1] regionserver.HStore(310): Store=e5a463a33d6b9653cb222327c1213dc1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:08,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:08,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:08,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:08,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5a463a33d6b9653cb222327c1213dc1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68403994, jitterRate=0.019298940896987915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:08,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5a463a33d6b9653cb222327c1213dc1: 2023-10-05 21:00:08,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:08,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1., pid=15, masterSystemTime=1696539608940 2023-10-05 21:00:08,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1ac4142746e8a744fd46bcfaeb1d6f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64648163, jitterRate=-0.03666730225086212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:08,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1ac4142746e8a744fd46bcfaeb1d6f7: 2023-10-05 21:00:08,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7., pid=16, masterSystemTime=1696539608941 2023-10-05 21:00:08,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:08,985 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e5a463a33d6b9653cb222327c1213dc1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:08,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539608985"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539608985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539608985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539608985"}]},"ts":"1696539608985"} 2023-10-05 21:00:08,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:08,987 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d1ac4142746e8a744fd46bcfaeb1d6f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:08,989 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539608987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539608987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539608987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539608987"}]},"ts":"1696539608987"} 2023-10-05 21:00:08,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-05 21:00:08,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure e5a463a33d6b9653cb222327c1213dc1, server=jenkins-hbase4.apache.org,34111,1696539600754 in 205 msec 2023-10-05 21:00:09,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-05 21:00:09,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure d1ac4142746e8a744fd46bcfaeb1d6f7, server=jenkins-hbase4.apache.org,35295,1696539600793 in 205 msec 2023-10-05 21:00:09,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, ASSIGN in 372 msec 2023-10-05 21:00:09,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-05 21:00:09,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, ASSIGN in 378 msec 2023-10-05 21:00:09,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:00:09,010 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539609009"}]},"ts":"1696539609009"} 2023-10-05 21:00:09,012 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-05 21:00:09,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 21:00:09,016 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:00:09,023 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-05 21:00:09,041 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 21:00:09,079 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:09,080 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:09,080 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:09,080 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:09,080 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:00:09,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:09,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:09,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:09,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:09,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 701 msec 2023-10-05 21:00:09,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 21:00:09,518 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-05 21:00:09,522 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 21:00:09,523 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:09,525 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:09,551 DEBUG [hconnection-0x61415aa9-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:09,554 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:09,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 21:00:09,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539609568 (current time:1696539609568). 2023-10-05 21:00:09,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:00:09,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x0dfe6f3d to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:09,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bc3efd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:09,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:09,579 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:09,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dfe6f3d to 127.0.0.1:54534 2023-10-05 21:00:09,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:09,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x751029d2 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@766ce380, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:09,591 DEBUG [hconnection-0x527ac0ae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:09,593 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:09,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x751029d2 to 127.0.0.1:54534 2023-10-05 21:00:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 21:00:09,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:00:09,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 21:00:09,627 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:09,627 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-05 21:00:09,629 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:09,629 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-05 21:00:09,629 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 21:00:09,629 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-05 21:00:09,629 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:09,629 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-05 21:00:09,630 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 21:00:09,630 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-05 21:00:09,634 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:00:09,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 21:00:09,656 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 21:00:09,657 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696540209657 2023-10-05 21:00:09,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 21:00:09,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 21:00:09,661 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 21:00:09,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 21:00:09,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-05 21:00:09,666 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 21:00:09,666 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:00:09,666 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:00:09,667 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696540209667 2023-10-05 21:00:09,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,699 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-05 21:00:09,699 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:09,700 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 21:00:09,700 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 21:00:09,700 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,700 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,707 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:09,707 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:09,707 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:09,707 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:09,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:09,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:09,708 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,708 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,708 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,708 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:00:09,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 21:00:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 21:00:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 21:00:09,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 21:00:09,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 21:00:09,711 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 21:00:09,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 21:00:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 21:00:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 21:00:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 21:00:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 21:00:09,722 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 21:00:09,722 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:09,722 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:09,722 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 21:00:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 21:00:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 21:00:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 21:00:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 21:00:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 21:00:09,726 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:09,727 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,727 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,727 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:09,729 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:09,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 21:00:09,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32921932[Count = 1] remaining members to acquire global barrier 2023-10-05 21:00:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:09,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 21:00:09,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32921932[Count = 0] remaining members to acquire global barrier 2023-10-05 21:00:09,735 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 21:00:09,735 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 21:00:09,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,737 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,738 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 21:00:09,738 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 21:00:09,738 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 21:00:09,738 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:00:09,738 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,738 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:00:09,738 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:09,739 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:09,739 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:09,739 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:09,739 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. started... 2023-10-05 21:00:09,739 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. started... 2023-10-05 21:00:09,739 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:09,739 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:09,742 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 21:00:09,742 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:09,742 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 21:00:09,743 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e5a463a33d6b9653cb222327c1213dc1: 2023-10-05 21:00:09,744 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,746 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1ac4142746e8a744fd46bcfaeb1d6f7: 2023-10-05 21:00:09,747 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,752 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:09,752 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:09,756 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:00:09,756 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:00:09,767 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:09,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 21:00:09,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:09,778 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:00:09,787 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. completed. 2023-10-05 21:00:09,787 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:09,788 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:09,788 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:09,788 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,788 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 21:00:09,788 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:00:09,788 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. completed. 2023-10-05 21:00:09,788 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:09,789 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:09,789 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:09,789 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,789 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 21:00:09,789 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 21:00:09,790 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:09,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:09,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 21:00:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 21:00:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:09,793 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 21:00:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:00:09,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 21:00:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34111,1696539600754': 2023-10-05 21:00:09,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 21:00:09,803 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-05 21:00:09,803 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:00:09,804 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:00:09,804 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,804 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:00:09,806 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,806 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,806 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,806 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,807 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:09,807 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:09,806 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:09,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:09,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:09,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:09,808 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,808 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,809 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,812 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:09,812 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,812 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:09,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:09,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:09,825 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,826 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,826 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:09,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:09,826 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:09,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 21:00:09,825 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:09,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,826 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:09,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:00:09,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:09,827 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:09,827 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,827 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 21:00:09,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 21:00:09,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,902 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:09,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696539609659Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696539609847 (+188 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696539609847Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696539609848 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696539609860 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696539609887 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696539609901 (+14 ms) 2023-10-05 21:00:09,904 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 21:00:09,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 243 msec 2023-10-05 21:00:09,978 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:09,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 21:00:09,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:00:09,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35295] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:00:09,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34111] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:00:10,003 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 21:00:10,003 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:10,003 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:10,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 21:00:10,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539610020 (current time:1696539610020). 2023-10-05 21:00:10,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:00:10,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x577dbbac to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21c48fd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:10,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:10,031 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:10,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x577dbbac to 127.0.0.1:54534 2023-10-05 21:00:10,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:10,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x766f061f to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:10,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cf563a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:10,040 DEBUG [hconnection-0x49cadff6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:10,041 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:10,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x766f061f to 127.0.0.1:54534 2023-10-05 21:00:10,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:10,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 21:00:10,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:00:10,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 21:00:10,050 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:00:10,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 21:00:10,053 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 21:00:10,054 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696540210054 2023-10-05 21:00:10,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 21:00:10,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 21:00:10,056 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:00:10,056 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:00:10,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 21:00:10,057 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 21:00:10,059 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-05 21:00:10,060 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 21:00:10,060 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696540210060 2023-10-05 21:00:10,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-05 21:00:10,076 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-05 21:00:10,076 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:10,077 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 21:00:10,077 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 21:00:10,078 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,078 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,079 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:10,079 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:10,079 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:10,079 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:10,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:10,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:10,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:10,080 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:10,080 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,080 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,081 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 21:00:10,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 21:00:10,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 21:00:10,082 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 21:00:10,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 21:00:10,085 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:10,085 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 21:00:10,086 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:10,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 21:00:10,086 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 21:00:10,086 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 21:00:10,087 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:10,086 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 21:00:10,085 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 21:00:10,088 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 21:00:10,088 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 21:00:10,088 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 21:00:10,088 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 21:00:10,088 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 21:00:10,088 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 21:00:10,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:10,092 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,093 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:10,093 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,093 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@85a546e[Count = 1] remaining members to acquire global barrier 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:10,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 21:00:10,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@85a546e[Count = 0] remaining members to acquire global barrier 2023-10-05 21:00:10,097 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 21:00:10,098 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 21:00:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:00:10,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,101 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,102 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 21:00:10,102 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. started... 2023-10-05 21:00:10,102 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,102 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:10,102 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:10,102 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:10,103 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e5a463a33d6b9653cb222327c1213dc1 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-05 21:00:10,103 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. started... 2023-10-05 21:00:10,103 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d1ac4142746e8a744fd46bcfaeb1d6f7 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-05 21:00:10,106 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 21:00:10,106 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:10,106 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 21:00:10,156 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:10,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 21:00:10,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:10,158 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:00:10,244 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005ec92c576fab1476a8f2001739fc104e6 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231005ec92c576fab1476a8f2001739fc104e6 2023-10-05 21:00:10,244 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005136d9b71bb3b4667890636eaacaeb6da to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005136d9b71bb3b4667890636eaacaeb6da 2023-10-05 21:00:10,276 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/.tmp/cf/06b6f69d275a4afca5ea4038e73e3b9c 2023-10-05 21:00:10,280 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/.tmp/cf/6fed2b661f274945a9e381ead0d71460 2023-10-05 21:00:10,290 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/.tmp/cf/6fed2b661f274945a9e381ead0d71460 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf/6fed2b661f274945a9e381ead0d71460 2023-10-05 21:00:10,290 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/.tmp/cf/06b6f69d275a4afca5ea4038e73e3b9c as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf/06b6f69d275a4afca5ea4038e73e3b9c 2023-10-05 21:00:10,299 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf/6fed2b661f274945a9e381ead0d71460, entries=5, sequenceid=6, filesize=5.7 K 2023-10-05 21:00:10,301 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf/06b6f69d275a4afca5ea4038e73e3b9c, entries=45, sequenceid=6, filesize=12.5 K 2023-10-05 21:00:10,304 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d1ac4142746e8a744fd46bcfaeb1d6f7 in 201ms, sequenceid=6, compaction requested=false 2023-10-05 21:00:10,304 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e5a463a33d6b9653cb222327c1213dc1 in 202ms, sequenceid=6, compaction requested=false 2023-10-05 21:00:10,304 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 21:00:10,304 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 21:00:10,306 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1ac4142746e8a744fd46bcfaeb1d6f7: 2023-10-05 21:00:10,306 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e5a463a33d6b9653cb222327c1213dc1: 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf/6fed2b661f274945a9e381ead0d71460] hfiles 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf/6fed2b661f274945a9e381ead0d71460 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf/06b6f69d275a4afca5ea4038e73e3b9c] hfiles 2023-10-05 21:00:10,307 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf/06b6f69d275a4afca5ea4038e73e3b9c for snapshot=snaptb0-testExportWithTargetName 2023-10-05 21:00:10,333 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. completed. 2023-10-05 21:00:10,333 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:10,334 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:10,334 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:10,334 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,334 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 21:00:10,334 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:00:10,335 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. completed. 2023-10-05 21:00:10,335 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:10,335 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:10,335 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:10,335 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,335 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 21:00:10,335 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:00:10,336 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 21:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:10,337 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 21:00:10,338 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,338 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 21:00:10,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:10,338 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:10,338 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 21:00:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:00:10,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 21:00:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:10,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:10,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:10,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34111,1696539600754': 2023-10-05 21:00:10,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 21:00:10,348 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-05 21:00:10,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:00:10,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:00:10,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-05 21:00:10,348 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:10,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,350 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:10,351 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:10,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:10,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:10,351 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,352 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,355 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:10,355 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 21:00:10,355 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,358 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:10,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 21:00:10,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:10,369 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 21:00:10,369 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,369 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:10,369 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:10,369 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:10,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:10,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:10,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:10,370 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:10,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:10,371 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-05 21:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:10,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:10,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:10,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:10,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 21:00:10,371 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,372 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:10,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 21:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:10,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:00:10,372 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:10,372 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:10,372 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:10,372 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,372 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:10,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231005ec92c576fab1476a8f2001739fc104e6, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005136d9b71bb3b4667890636eaacaeb6da] mob files 2023-10-05 21:00:10,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231005ec92c576fab1476a8f2001739fc104e6 2023-10-05 21:00:10,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005136d9b71bb3b4667890636eaacaeb6da 2023-10-05 21:00:10,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-05 21:00:10,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 21:00:10,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,431 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 21:00:10,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696539610055Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696539610388 (+333 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696539610388Loading Region manifests for snaptb0-testExportWithTargetName at 1696539610388Writing data manifest for snaptb0-testExportWithTargetName at 1696539610394 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696539610418 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696539610431 (+13 ms) 2023-10-05 21:00:10,434 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 21:00:10,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 379 msec 2023-10-05 21:00:10,669 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:10,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 21:00:10,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:00:10,673 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673 2023-10-05 21:00:10,674 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43021, tgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673, rawTgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:10,712 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:10,712 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1841850173_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 21:00:10,712 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-05 21:00:10,731 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 21:00:10,797 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,798 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,799 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,800 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,800 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,801 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,801 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,884 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-572814682313856011.jar 2023-10-05 21:00:10,885 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,885 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,886 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,886 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,887 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,887 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:10,888 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:00:10,888 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:00:10,889 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:00:10,890 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:00:10,890 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:00:10,891 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:00:10,892 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:00:10,892 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:00:10,893 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:00:10,894 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:00:10,898 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:10,898 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:10,899 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:10,899 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:10,900 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:10,901 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:10,901 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:11,732 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:00:11,739 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-05 21:00:11,748 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 21:00:12,216 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:12,218 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:12,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0001_000001 (auth:SIMPLE) 2023-10-05 21:00:14,453 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:00:16,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0001_000001 (auth:SIMPLE) 2023-10-05 21:00:19,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0001_000001 (auth:SIMPLE) 2023-10-05 21:00:22,328 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0001_000001 (auth:SIMPLE) 2023-10-05 21:00:23,582 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:00:23,586 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:00:23,598 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-05 21:00:23,598 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:00:23,599 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:00:23,599 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 21:00:23,600 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-05 21:00:23,600 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-05 21:00:23,600 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673/.hbase-snapshot/testExportWithTargetName 2023-10-05 21:00:23,600 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-05 21:00:23,601 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539610673/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-05 21:00:23,612 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-05 21:00:23,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-05 21:00:23,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:23,629 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539623629"}]},"ts":"1696539623629"} 2023-10-05 21:00:23,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 21:00:23,631 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-05 21:00:23,633 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-05 21:00:23,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, UNASSIGN}] 2023-10-05 21:00:23,637 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, UNASSIGN 2023-10-05 21:00:23,637 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, UNASSIGN 2023-10-05 21:00:23,638 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d1ac4142746e8a744fd46bcfaeb1d6f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:23,638 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e5a463a33d6b9653cb222327c1213dc1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:23,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539623638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539623638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539623638"}]},"ts":"1696539623638"} 2023-10-05 21:00:23,639 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539623638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539623638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539623638"}]},"ts":"1696539623638"} 2023-10-05 21:00:23,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure d1ac4142746e8a744fd46bcfaeb1d6f7, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:00:23,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure e5a463a33d6b9653cb222327c1213dc1, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:00:23,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 21:00:23,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:23,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5a463a33d6b9653cb222327c1213dc1, disabling compactions & flushes 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1ac4142746e8a744fd46bcfaeb1d6f7, disabling compactions & flushes 2023-10-05 21:00:23,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:23,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. after waiting 0 ms 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. after waiting 0 ms 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:23,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:23,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:00:23,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:23,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7. 2023-10-05 21:00:23,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1ac4142746e8a744fd46bcfaeb1d6f7: 2023-10-05 21:00:23,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:00:23,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:23,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1. 2023-10-05 21:00:23,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5a463a33d6b9653cb222327c1213dc1: 2023-10-05 21:00:23,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:23,825 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d1ac4142746e8a744fd46bcfaeb1d6f7, regionState=CLOSED 2023-10-05 21:00:23,826 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539623825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539623825"}]},"ts":"1696539623825"} 2023-10-05 21:00:23,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:23,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e5a463a33d6b9653cb222327c1213dc1, regionState=CLOSED 2023-10-05 21:00:23,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696539623826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539623826"}]},"ts":"1696539623826"} 2023-10-05 21:00:23,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-05 21:00:23,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure d1ac4142746e8a744fd46bcfaeb1d6f7, server=jenkins-hbase4.apache.org,35295,1696539600793 in 188 msec 2023-10-05 21:00:23,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-05 21:00:23,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure e5a463a33d6b9653cb222327c1213dc1, server=jenkins-hbase4.apache.org,34111,1696539600754 in 184 msec 2023-10-05 21:00:23,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1ac4142746e8a744fd46bcfaeb1d6f7, UNASSIGN in 197 msec 2023-10-05 21:00:23,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-05 21:00:23,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5a463a33d6b9653cb222327c1213dc1, UNASSIGN in 198 msec 2023-10-05 21:00:23,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539623837"}]},"ts":"1696539623837"} 2023-10-05 21:00:23,838 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-05 21:00:23,840 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-05 21:00:23,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-10-05 21:00:23,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 21:00:23,933 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-05 21:00:23,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-05 21:00:23,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:23,949 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-05 21:00:23,951 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:23,954 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-05 21:00:23,958 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 21:00:23,958 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 21:00:23,959 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 21:00:23,959 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 21:00:23,960 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:23,960 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:23,961 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:23,961 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:23,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 21:00:23,965 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:23,965 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:23,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 21:00:23,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 21:00:23,966 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:00:23,966 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:00:23,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 21:00:23,966 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:00:23,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 21:00:23,966 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:00:23,969 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/recovered.edits] 2023-10-05 21:00:23,969 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/recovered.edits] 2023-10-05 21:00:23,977 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf/6fed2b661f274945a9e381ead0d71460 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/cf/6fed2b661f274945a9e381ead0d71460 2023-10-05 21:00:23,977 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf/06b6f69d275a4afca5ea4038e73e3b9c to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/cf/06b6f69d275a4afca5ea4038e73e3b9c 2023-10-05 21:00:23,981 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7/recovered.edits/9.seqid 2023-10-05 21:00:23,981 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1/recovered.edits/9.seqid 2023-10-05 21:00:23,982 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/d1ac4142746e8a744fd46bcfaeb1d6f7 2023-10-05 21:00:23,982 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportWithTargetName/e5a463a33d6b9653cb222327c1213dc1 2023-10-05 21:00:23,982 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 21:00:23,982 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 21:00:23,983 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-05 21:00:23,987 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231005ec92c576fab1476a8f2001739fc104e6 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231005ec92c576fab1476a8f2001739fc104e6 2023-10-05 21:00:23,988 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005136d9b71bb3b4667890636eaacaeb6da to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005136d9b71bb3b4667890636eaacaeb6da 2023-10-05 21:00:23,989 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 21:00:23,992 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:24,021 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-05 21:00:24,024 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-05 21:00:24,025 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:24,025 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-05 21:00:24,026 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539624026"}]},"ts":"9223372036854775807"} 2023-10-05 21:00:24,026 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539624026"}]},"ts":"9223372036854775807"} 2023-10-05 21:00:24,028 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 21:00:24,028 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d1ac4142746e8a744fd46bcfaeb1d6f7, NAME => 'testtb-testExportWithTargetName,,1696539608385.d1ac4142746e8a744fd46bcfaeb1d6f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e5a463a33d6b9653cb222327c1213dc1, NAME => 'testtb-testExportWithTargetName,1,1696539608385.e5a463a33d6b9653cb222327c1213dc1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 21:00:24,028 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-05 21:00:24,028 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539624028"}]},"ts":"9223372036854775807"} 2023-10-05 21:00:24,030 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-05 21:00:24,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 21:00:24,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 93 msec 2023-10-05 21:00:24,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 21:00:24,068 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-05 21:00:24,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-05 21:00:24,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-05 21:00:24,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-05 21:00:24,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-05 21:00:24,125 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 703) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1841850173_17 at /127.0.0.1:35182 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:40083 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:37830 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_291371761_1 at /127.0.0.1:35146 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_291371761_1 at /127.0.0.1:37818 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:37149 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:33673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:38752 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:39595 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=937 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6043 (was 6831) 2023-10-05 21:00:24,125 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-05 21:00:24,145 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=169, AvailableMemoryMB=6041 2023-10-05 21:00:24,145 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-05 21:00:24,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 21:00:24,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:24,153 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:00:24,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-05 21:00:24,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 21:00:24,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:00:24,158 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,158 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,159 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c empty. 2023-10-05 21:00:24,159 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 empty. 2023-10-05 21:00:24,159 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,159 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 21:00:24,172 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:24,174 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 402dd4d93e56eb457a4bae7d5df4ba7c, NAME => 'testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:24,174 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8ea36824f259990dc8edad017b1f6be1, NAME => 'testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:24,195 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:24,196 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8ea36824f259990dc8edad017b1f6be1, disabling compactions & flushes 2023-10-05 21:00:24,196 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,196 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,196 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. after waiting 0 ms 2023-10-05 21:00:24,196 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,196 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,196 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8ea36824f259990dc8edad017b1f6be1: 2023-10-05 21:00:24,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 21:00:24,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 21:00:24,596 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:24,596 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 402dd4d93e56eb457a4bae7d5df4ba7c, disabling compactions & flushes 2023-10-05 21:00:24,597 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. after waiting 0 ms 2023-10-05 21:00:24,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,597 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 402dd4d93e56eb457a4bae7d5df4ba7c: 2023-10-05 21:00:24,600 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:00:24,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539624601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539624601"}]},"ts":"1696539624601"} 2023-10-05 21:00:24,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539624601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539624601"}]},"ts":"1696539624601"} 2023-10-05 21:00:24,604 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:00:24,607 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:00:24,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539624607"}]},"ts":"1696539624607"} 2023-10-05 21:00:24,609 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 21:00:24,613 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:00:24,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:00:24,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:00:24,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:00:24,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:00:24,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, ASSIGN}] 2023-10-05 21:00:24,617 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, ASSIGN 2023-10-05 21:00:24,617 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, ASSIGN 2023-10-05 21:00:24,618 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37883,1696539600708; forceNewPlan=false, retain=false 2023-10-05 21:00:24,618 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:00:24,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 21:00:24,769 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:00:24,771 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8ea36824f259990dc8edad017b1f6be1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:24,771 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=402dd4d93e56eb457a4bae7d5df4ba7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:24,772 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539624771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539624771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539624771"}]},"ts":"1696539624771"} 2023-10-05 21:00:24,772 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539624771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539624771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539624771"}]},"ts":"1696539624771"} 2023-10-05 21:00:24,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 402dd4d93e56eb457a4bae7d5df4ba7c, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:00:24,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 8ea36824f259990dc8edad017b1f6be1, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:00:24,928 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:24,928 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 21:00:24,932 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 21:00:24,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ea36824f259990dc8edad017b1f6be1, NAME => 'testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 21:00:24,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. service=AccessControlService 2023-10-05 21:00:24,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,939 INFO [StoreOpener-8ea36824f259990dc8edad017b1f6be1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 402dd4d93e56eb457a4bae7d5df4ba7c, NAME => 'testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 21:00:24,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. service=AccessControlService 2023-10-05 21:00:24,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:24,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:24,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,940 DEBUG [StoreOpener-8ea36824f259990dc8edad017b1f6be1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf 2023-10-05 21:00:24,941 DEBUG [StoreOpener-8ea36824f259990dc8edad017b1f6be1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf 2023-10-05 21:00:24,941 INFO [StoreOpener-8ea36824f259990dc8edad017b1f6be1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ea36824f259990dc8edad017b1f6be1 columnFamilyName cf 2023-10-05 21:00:24,942 INFO [StoreOpener-402dd4d93e56eb457a4bae7d5df4ba7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,943 INFO [StoreOpener-8ea36824f259990dc8edad017b1f6be1-1] regionserver.HStore(310): Store=8ea36824f259990dc8edad017b1f6be1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:24,944 DEBUG [StoreOpener-402dd4d93e56eb457a4bae7d5df4ba7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf 2023-10-05 21:00:24,944 DEBUG [StoreOpener-402dd4d93e56eb457a4bae7d5df4ba7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf 2023-10-05 21:00:24,945 INFO [StoreOpener-402dd4d93e56eb457a4bae7d5df4ba7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 402dd4d93e56eb457a4bae7d5df4ba7c columnFamilyName cf 2023-10-05 21:00:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,946 INFO [StoreOpener-402dd4d93e56eb457a4bae7d5df4ba7c-1] regionserver.HStore(310): Store=402dd4d93e56eb457a4bae7d5df4ba7c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:24,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:24,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:24,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:24,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8ea36824f259990dc8edad017b1f6be1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73746870, jitterRate=0.0989139974117279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:24,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8ea36824f259990dc8edad017b1f6be1: 2023-10-05 21:00:24,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:24,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1., pid=31, masterSystemTime=1696539624928 2023-10-05 21:00:24,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 402dd4d93e56eb457a4bae7d5df4ba7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74503899, jitterRate=0.1101946085691452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:24,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 402dd4d93e56eb457a4bae7d5df4ba7c: 2023-10-05 21:00:24,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c., pid=30, masterSystemTime=1696539624928 2023-10-05 21:00:24,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:24,961 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8ea36824f259990dc8edad017b1f6be1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:24,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:24,962 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539624961"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539624961"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539624961"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539624961"}]},"ts":"1696539624961"} 2023-10-05 21:00:24,962 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=402dd4d93e56eb457a4bae7d5df4ba7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:24,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539624962"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539624962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539624962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539624962"}]},"ts":"1696539624962"} 2023-10-05 21:00:24,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-05 21:00:24,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 8ea36824f259990dc8edad017b1f6be1, server=jenkins-hbase4.apache.org,35295,1696539600793 in 189 msec 2023-10-05 21:00:24,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-05 21:00:24,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 402dd4d93e56eb457a4bae7d5df4ba7c, server=jenkins-hbase4.apache.org,37883,1696539600708 in 192 msec 2023-10-05 21:00:24,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, ASSIGN in 353 msec 2023-10-05 21:00:24,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-05 21:00:24,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, ASSIGN in 358 msec 2023-10-05 21:00:24,977 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:00:24,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539624977"}]},"ts":"1696539624977"} 2023-10-05 21:00:24,978 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 21:00:24,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:00:24,982 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-05 21:00:24,984 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 21:00:24,985 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:24,985 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:24,985 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:24,986 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:24,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:24,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:24,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:24,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:24,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 838 msec 2023-10-05 21:00:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 21:00:25,261 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-05 21:00:25,264 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 21:00:25,265 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:25,267 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:25,277 DEBUG [hconnection-0x61415aa9-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:25,282 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:25,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:00:25,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539625288 (current time:1696539625288). 2023-10-05 21:00:25,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:00:25,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x5a37afe8 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:25,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@777b4df1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:25,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:25,300 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:25,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a37afe8 to 127.0.0.1:54534 2023-10-05 21:00:25,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:25,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x4a1cb5de to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:25,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2db30b9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:25,309 DEBUG [hconnection-0x8adf18-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:25,312 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:25,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a1cb5de to 127.0.0.1:54534 2023-10-05 21:00:25,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:25,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 21:00:25,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:00:25,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:00:25,323 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:00:25,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:00:25,326 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:00:25,327 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696540225327 2023-10-05 21:00:25,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:00:25,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 21:00:25,328 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:00:25,328 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:00:25,329 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:00:25,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 21:00:25,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-05 21:00:25,331 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 21:00:25,332 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696540225332 2023-10-05 21:00:25,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,347 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-05 21:00:25,347 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 21:00:25,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 21:00:25,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,348 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,351 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,351 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,351 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,351 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,351 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,351 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,352 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,352 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 21:00:25,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 21:00:25,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 21:00:25,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,353 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 21:00:25,353 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 21:00:25,353 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,353 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,354 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 21:00:25,354 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 21:00:25,355 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,355 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 21:00:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 21:00:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 21:00:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 21:00:25,355 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 21:00:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 21:00:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 21:00:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 21:00:25,363 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,363 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,363 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,363 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,363 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,363 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,364 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:25,363 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,364 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:25,364 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,364 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@368fc5b9[Count = 1] remaining members to acquire global barrier 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 21:00:25,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@368fc5b9[Count = 0] remaining members to acquire global barrier 2023-10-05 21:00:25,368 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 21:00:25,368 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:00:25,378 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:25,379 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 21:00:25,379 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:00:25,379 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. started... 2023-10-05 21:00:25,379 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,380 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:00:25,380 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ea36824f259990dc8edad017b1f6be1: 2023-10-05 21:00:25,379 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. started... 2023-10-05 21:00:25,380 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 402dd4d93e56eb457a4bae7d5df4ba7c: 2023-10-05 21:00:25,380 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,381 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:25,381 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,381 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:00:25,381 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:25,381 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:00:25,381 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 21:00:25,381 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,381 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 21:00:25,396 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. completed. 2023-10-05 21:00:25,397 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:25,397 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:25,397 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:25,397 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,397 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 21:00:25,397 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:00:25,399 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. completed. 2023-10-05 21:00:25,399 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 21:00:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:00:25,400 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 21:00:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 21:00:25,401 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,401 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 21:00:25,402 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,402 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 21:00:25,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:00:25,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 21:00:25,410 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-05 21:00:25,410 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:00:25,410 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:00:25,410 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,410 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:00:25,412 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,412 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,412 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,412 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,412 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,412 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,413 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,413 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,413 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,415 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,417 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,418 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,418 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,422 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,421 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,423 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,422 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 21:00:25,423 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,423 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:00:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,423 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,423 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 21:00:25,428 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:25,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:00:25,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:25,429 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:00:25,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 21:00:25,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,463 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:25,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696539625327Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696539625437 (+110 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696539625437Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696539625437Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696539625442 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696539625453 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696539625462 (+9 ms) 2023-10-05 21:00:25,465 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 21:00:25,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 137 msec 2023-10-05 21:00:25,630 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:25,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:00:25,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:00:25,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:00:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35295] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:00:25,641 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 21:00:25,641 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:25,641 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:25,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:00:25,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539625654 (current time:1696539625654). 2023-10-05 21:00:25,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:00:25,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x0673508d to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:25,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53f4267e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:25,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:25,669 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:25,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0673508d to 127.0.0.1:54534 2023-10-05 21:00:25,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:25,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x2d785ed2 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:25,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43269342, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:25,680 DEBUG [hconnection-0x14e944ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:25,681 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d785ed2 to 127.0.0.1:54534 2023-10-05 21:00:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 21:00:25,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:00:25,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:00:25,691 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:00:25,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:00:25,694 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:00:25,695 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696540225695 2023-10-05 21:00:25,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:00:25,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 21:00:25,696 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:00:25,697 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:00:25,697 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:00:25,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 21:00:25,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-05 21:00:25,701 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 21:00:25,702 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696540225702 2023-10-05 21:00:25,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-05 21:00:25,713 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-05 21:00:25,713 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,715 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 21:00:25,715 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 21:00:25,715 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,715 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,718 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,718 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,718 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,718 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,718 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,718 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,719 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,719 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 21:00:25,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 21:00:25,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 21:00:25,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 21:00:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 21:00:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 21:00:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 21:00:25,721 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 21:00:25,721 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 21:00:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,721 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 21:00:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,722 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 21:00:25,722 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 21:00:25,722 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 21:00:25,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 21:00:25,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 21:00:25,723 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 21:00:25,723 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:25,724 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 21:00:25,724 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 21:00:25,724 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 21:00:25,724 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,724 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,725 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,725 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,725 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,725 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7515a3be[Count = 1] remaining members to acquire global barrier 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 21:00:25,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7515a3be[Count = 0] remaining members to acquire global barrier 2023-10-05 21:00:25,730 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 21:00:25,730 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:00:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:00:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 21:00:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:00:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:00:25,733 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,733 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:00:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:25,733 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:25,733 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:25,733 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. started... 2023-10-05 21:00:25,733 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. started... 2023-10-05 21:00:25,733 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 402dd4d93e56eb457a4bae7d5df4ba7c 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-10-05 21:00:25,733 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ea36824f259990dc8edad017b1f6be1 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-10-05 21:00:25,734 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 21:00:25,734 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,734 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 21:00:25,762 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005f136aaece1fa499894a437d59074954f to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005f136aaece1fa499894a437d59074954f 2023-10-05 21:00:25,766 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005093039e07f9a4ebe94f8c66b0387879b to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005093039e07f9a4ebe94f8c66b0387879b 2023-10-05 21:00:25,782 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=534, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/.tmp/cf/9727c13ab7014b5aa5482b5a230b584f 2023-10-05 21:00:25,785 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/.tmp/cf/ca409c0dd9ae4e67823bc98a55bf8e2a 2023-10-05 21:00:25,789 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/.tmp/cf/9727c13ab7014b5aa5482b5a230b584f as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf/9727c13ab7014b5aa5482b5a230b584f 2023-10-05 21:00:25,791 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/.tmp/cf/ca409c0dd9ae4e67823bc98a55bf8e2a as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf/ca409c0dd9ae4e67823bc98a55bf8e2a 2023-10-05 21:00:25,795 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf/9727c13ab7014b5aa5482b5a230b584f, entries=8, sequenceid=6, filesize=6.2 K 2023-10-05 21:00:25,796 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 402dd4d93e56eb457a4bae7d5df4ba7c in 63ms, sequenceid=6, compaction requested=false 2023-10-05 21:00:25,796 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 21:00:25,797 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 402dd4d93e56eb457a4bae7d5df4ba7c: 2023-10-05 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf/9727c13ab7014b5aa5482b5a230b584f] hfiles 2023-10-05 21:00:25,797 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf/ca409c0dd9ae4e67823bc98a55bf8e2a, entries=42, sequenceid=6, filesize=12.0 K 2023-10-05 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf/9727c13ab7014b5aa5482b5a230b584f for snapshot=snaptb0-testExportFileSystemState 2023-10-05 21:00:25,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:00:25,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:25,798 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:00:25,801 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 8ea36824f259990dc8edad017b1f6be1 in 68ms, sequenceid=6, compaction requested=false 2023-10-05 21:00:25,802 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ea36824f259990dc8edad017b1f6be1: 2023-10-05 21:00:25,803 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 21:00:25,803 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:25,803 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf/ca409c0dd9ae4e67823bc98a55bf8e2a] hfiles 2023-10-05 21:00:25,803 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf/ca409c0dd9ae4e67823bc98a55bf8e2a for snapshot=snaptb0-testExportFileSystemState 2023-10-05 21:00:25,810 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. completed. 2023-10-05 21:00:25,810 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:25,810 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:25,810 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:25,810 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,810 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 21:00:25,810 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:00:25,815 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 21:00:25,815 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,815 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,815 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 21:00:25,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,818 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. completed. 2023-10-05 21:00:25,818 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:25,818 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:25,818 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:25,819 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,819 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 21:00:25,819 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:00:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,821 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 21:00:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:00:25,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 21:00:25,829 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-05 21:00:25,829 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:00:25,829 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:00:25,829 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-05 21:00:25,829 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,831 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,831 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:25,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,832 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,833 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,834 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:25,835 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 21:00:25,835 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,838 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,838 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,838 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,838 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,838 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,838 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:25,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:25,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-05 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:25,839 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:25,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 21:00:25,839 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,839 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,839 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:25,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,839 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:00:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,841 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005093039e07f9a4ebe94f8c66b0387879b, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005f136aaece1fa499894a437d59074954f] mob files 2023-10-05 21:00:25,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005093039e07f9a4ebe94f8c66b0387879b 2023-10-05 21:00:25,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005f136aaece1fa499894a437d59074954f 2023-10-05 21:00:25,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-05 21:00:25,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 21:00:25,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,877 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 21:00:25,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696539625695Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696539625850 (+155 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696539625850Loading Region manifests for snaptb0-testExportFileSystemState at 1696539625851 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1696539625855 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696539625866 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696539625877 (+11 ms) 2023-10-05 21:00:25,879 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 21:00:25,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 182 msec 2023-10-05 21:00:25,999 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:26,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:00:26,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:00:26,000 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000 2023-10-05 21:00:26,000 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43021, tgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000, rawTgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:26,027 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:26,027 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_201632696_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 21:00:26,027 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-05 21:00:26,041 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 21:00:26,079 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,080 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,080 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,081 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,081 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,081 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,082 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,155 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-7153281048362894452.jar 2023-10-05 21:00:26,155 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,156 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,156 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,156 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,157 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,157 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:26,157 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:00:26,158 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:00:26,158 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:00:26,159 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:00:26,159 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:00:26,159 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:00:26,160 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:00:26,160 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:00:26,160 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:00:26,161 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:00:26,161 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:26,162 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:26,162 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:26,162 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:26,162 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:26,163 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:26,163 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:26,604 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:00:26,607 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-05 21:00:26,610 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 21:00:28,539 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:28,539 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:28,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0001_000001 (auth:SIMPLE) 2023-10-05 21:00:29,358 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0002_000001 (auth:SIMPLE) 2023-10-05 21:00:29,411 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:00:33,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0002_000001 (auth:SIMPLE) 2023-10-05 21:00:35,448 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0002_000001 (auth:SIMPLE) 2023-10-05 21:00:38,073 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0002_000001 (auth:SIMPLE) 2023-10-05 21:00:39,825 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:00:39,826 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:00:39,834 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-05 21:00:39,835 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:00:39,835 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:00:39,835 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 21:00:39,836 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 21:00:39,836 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 21:00:39,836 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 21:00:39,836 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 21:00:39,837 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539626000/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 21:00:39,843 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-05 21:00:39,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-05 21:00:39,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:39,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 21:00:39,849 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539639849"}]},"ts":"1696539639849"} 2023-10-05 21:00:39,851 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 21:00:39,852 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-05 21:00:39,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, UNASSIGN}] 2023-10-05 21:00:39,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, UNASSIGN 2023-10-05 21:00:39,855 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, UNASSIGN 2023-10-05 21:00:39,856 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=402dd4d93e56eb457a4bae7d5df4ba7c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:39,856 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539639856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539639856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539639856"}]},"ts":"1696539639856"} 2023-10-05 21:00:39,857 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8ea36824f259990dc8edad017b1f6be1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:39,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539639856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539639856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539639856"}]},"ts":"1696539639856"} 2023-10-05 21:00:39,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 402dd4d93e56eb457a4bae7d5df4ba7c, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:00:39,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 8ea36824f259990dc8edad017b1f6be1, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:00:39,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 21:00:40,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:40,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 402dd4d93e56eb457a4bae7d5df4ba7c, disabling compactions & flushes 2023-10-05 21:00:40,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:40,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:40,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. after waiting 0 ms 2023-10-05 21:00:40,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:40,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:40,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8ea36824f259990dc8edad017b1f6be1, disabling compactions & flushes 2023-10-05 21:00:40,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:40,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:40,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. after waiting 0 ms 2023-10-05 21:00:40,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:00:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:00:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:00:40,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c. 2023-10-05 21:00:40,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1. 2023-10-05 21:00:40,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 402dd4d93e56eb457a4bae7d5df4ba7c: 2023-10-05 21:00:40,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8ea36824f259990dc8edad017b1f6be1: 2023-10-05 21:00:40,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:40,027 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=402dd4d93e56eb457a4bae7d5df4ba7c, regionState=CLOSED 2023-10-05 21:00:40,027 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539640027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539640027"}]},"ts":"1696539640027"} 2023-10-05 21:00:40,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:40,027 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8ea36824f259990dc8edad017b1f6be1, regionState=CLOSED 2023-10-05 21:00:40,028 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696539640027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539640027"}]},"ts":"1696539640027"} 2023-10-05 21:00:40,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-05 21:00:40,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 402dd4d93e56eb457a4bae7d5df4ba7c, server=jenkins-hbase4.apache.org,37883,1696539600708 in 170 msec 2023-10-05 21:00:40,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-05 21:00:40,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 8ea36824f259990dc8edad017b1f6be1, server=jenkins-hbase4.apache.org,35295,1696539600793 in 170 msec 2023-10-05 21:00:40,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=402dd4d93e56eb457a4bae7d5df4ba7c, UNASSIGN in 177 msec 2023-10-05 21:00:40,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-05 21:00:40,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea36824f259990dc8edad017b1f6be1, UNASSIGN in 179 msec 2023-10-05 21:00:40,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539640035"}]},"ts":"1696539640035"} 2023-10-05 21:00:40,036 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 21:00:40,037 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-05 21:00:40,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-10-05 21:00:40,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 21:00:40,151 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-05 21:00:40,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-05 21:00:40,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:40,156 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:40,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-05 21:00:40,157 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:40,159 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-05 21:00:40,162 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:40,163 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,163 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,163 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,163 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 21:00:40,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 21:00:40,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 21:00:40,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 21:00:40,165 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 21:00:40,173 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:40,174 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/recovered.edits] 2023-10-05 21:00:40,175 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/recovered.edits] 2023-10-05 21:00:40,179 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf/9727c13ab7014b5aa5482b5a230b584f to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/cf/9727c13ab7014b5aa5482b5a230b584f 2023-10-05 21:00:40,180 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf/ca409c0dd9ae4e67823bc98a55bf8e2a to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/cf/ca409c0dd9ae4e67823bc98a55bf8e2a 2023-10-05 21:00:40,182 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c/recovered.edits/9.seqid 2023-10-05 21:00:40,183 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/402dd4d93e56eb457a4bae7d5df4ba7c 2023-10-05 21:00:40,184 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1/recovered.edits/9.seqid 2023-10-05 21:00:40,184 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemState/8ea36824f259990dc8edad017b1f6be1 2023-10-05 21:00:40,184 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 21:00:40,185 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 21:00:40,185 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-05 21:00:40,189 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005093039e07f9a4ebe94f8c66b0387879b to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005093039e07f9a4ebe94f8c66b0387879b 2023-10-05 21:00:40,190 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005f136aaece1fa499894a437d59074954f to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005f136aaece1fa499894a437d59074954f 2023-10-05 21:00:40,191 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 21:00:40,193 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:40,196 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-05 21:00:40,199 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-05 21:00:40,200 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:40,200 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-05 21:00:40,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539640200"}]},"ts":"9223372036854775807"} 2023-10-05 21:00:40,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539640200"}]},"ts":"9223372036854775807"} 2023-10-05 21:00:40,202 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 21:00:40,203 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 402dd4d93e56eb457a4bae7d5df4ba7c, NAME => 'testtb-testExportFileSystemState,,1696539624147.402dd4d93e56eb457a4bae7d5df4ba7c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8ea36824f259990dc8edad017b1f6be1, NAME => 'testtb-testExportFileSystemState,1,1696539624147.8ea36824f259990dc8edad017b1f6be1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 21:00:40,203 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-05 21:00:40,203 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539640203"}]},"ts":"9223372036854775807"} 2023-10-05 21:00:40,210 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-05 21:00:40,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 21:00:40,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 60 msec 2023-10-05 21:00:40,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 21:00:40,268 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-05 21:00:40,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-05 21:00:40,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-05 21:00:40,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-05 21:00:40,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-05 21:00:40,318 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 753) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_494001928_1 at /127.0.0.1:45094 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:41325 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:42900 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:45114 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:34944 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=277 (was 272) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=5922 (was 6041) 2023-10-05 21:00:40,318 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 21:00:40,343 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=168, AvailableMemoryMB=5921 2023-10-05 21:00:40,343 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 21:00:40,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 21:00:40,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:00:40,349 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:00:40,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-05 21:00:40,351 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:00:40,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 21:00:40,353 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,353 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,354 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 empty. 2023-10-05 21:00:40,354 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead empty. 2023-10-05 21:00:40,354 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,355 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,355 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 21:00:40,367 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-05 21:00:40,369 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b576fc79ba0b58c7d3a0060debf2cead, NAME => 'testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:40,369 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c82741b5c3728ffab4248b35183c1411, NAME => 'testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:00:40,386 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:40,387 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b576fc79ba0b58c7d3a0060debf2cead, disabling compactions & flushes 2023-10-05 21:00:40,387 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,387 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,387 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. after waiting 0 ms 2023-10-05 21:00:40,387 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,387 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,387 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b576fc79ba0b58c7d3a0060debf2cead: 2023-10-05 21:00:40,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:40,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c82741b5c3728ffab4248b35183c1411, disabling compactions & flushes 2023-10-05 21:00:40,389 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. after waiting 0 ms 2023-10-05 21:00:40,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,389 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c82741b5c3728ffab4248b35183c1411: 2023-10-05 21:00:40,392 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:00:40,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539640393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539640393"}]},"ts":"1696539640393"} 2023-10-05 21:00:40,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539640393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539640393"}]},"ts":"1696539640393"} 2023-10-05 21:00:40,396 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:00:40,397 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:00:40,397 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539640397"}]},"ts":"1696539640397"} 2023-10-05 21:00:40,399 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-05 21:00:40,403 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:00:40,405 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:00:40,405 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:00:40,405 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:00:40,405 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:00:40,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, ASSIGN}] 2023-10-05 21:00:40,408 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, ASSIGN 2023-10-05 21:00:40,408 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, ASSIGN 2023-10-05 21:00:40,410 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37883,1696539600708; forceNewPlan=false, retain=false 2023-10-05 21:00:40,410 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34111,1696539600754; forceNewPlan=false, retain=false 2023-10-05 21:00:40,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 21:00:40,560 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:00:40,563 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b576fc79ba0b58c7d3a0060debf2cead, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:40,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c82741b5c3728ffab4248b35183c1411, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:40,563 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539640562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539640562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539640562"}]},"ts":"1696539640562"} 2023-10-05 21:00:40,563 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539640562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539640562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539640562"}]},"ts":"1696539640562"} 2023-10-05 21:00:40,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure b576fc79ba0b58c7d3a0060debf2cead, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:00:40,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure c82741b5c3728ffab4248b35183c1411, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:00:40,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 21:00:40,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b576fc79ba0b58c7d3a0060debf2cead, NAME => 'testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 21:00:40,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c82741b5c3728ffab4248b35183c1411, NAME => 'testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 21:00:40,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. service=AccessControlService 2023-10-05 21:00:40,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. service=AccessControlService 2023-10-05 21:00:40,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:40,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,723 INFO [StoreOpener-b576fc79ba0b58c7d3a0060debf2cead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,723 INFO [StoreOpener-c82741b5c3728ffab4248b35183c1411-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,725 DEBUG [StoreOpener-b576fc79ba0b58c7d3a0060debf2cead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf 2023-10-05 21:00:40,725 DEBUG [StoreOpener-c82741b5c3728ffab4248b35183c1411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf 2023-10-05 21:00:40,725 DEBUG [StoreOpener-c82741b5c3728ffab4248b35183c1411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf 2023-10-05 21:00:40,725 DEBUG [StoreOpener-b576fc79ba0b58c7d3a0060debf2cead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf 2023-10-05 21:00:40,725 INFO [StoreOpener-c82741b5c3728ffab4248b35183c1411-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c82741b5c3728ffab4248b35183c1411 columnFamilyName cf 2023-10-05 21:00:40,725 INFO [StoreOpener-b576fc79ba0b58c7d3a0060debf2cead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b576fc79ba0b58c7d3a0060debf2cead columnFamilyName cf 2023-10-05 21:00:40,727 INFO [StoreOpener-b576fc79ba0b58c7d3a0060debf2cead-1] regionserver.HStore(310): Store=b576fc79ba0b58c7d3a0060debf2cead/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:40,727 INFO [StoreOpener-c82741b5c3728ffab4248b35183c1411-1] regionserver.HStore(310): Store=c82741b5c3728ffab4248b35183c1411/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:00:40,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c82741b5c3728ffab4248b35183c1411 2023-10-05 21:00:40,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:00:40,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:40,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:00:40,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c82741b5c3728ffab4248b35183c1411; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72427780, jitterRate=0.0792580246925354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:40,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b576fc79ba0b58c7d3a0060debf2cead; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62763723, jitterRate=-0.0647476464509964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:00:40,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c82741b5c3728ffab4248b35183c1411: 2023-10-05 21:00:40,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b576fc79ba0b58c7d3a0060debf2cead: 2023-10-05 21:00:40,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead., pid=45, masterSystemTime=1696539640717 2023-10-05 21:00:40,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411., pid=46, masterSystemTime=1696539640718 2023-10-05 21:00:40,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:40,738 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b576fc79ba0b58c7d3a0060debf2cead, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:40,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539640738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539640738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539640738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539640738"}]},"ts":"1696539640738"} 2023-10-05 21:00:40,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,739 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c82741b5c3728ffab4248b35183c1411, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:40,740 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539640739"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539640739"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539640739"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539640739"}]},"ts":"1696539640739"} 2023-10-05 21:00:40,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-05 21:00:40,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure b576fc79ba0b58c7d3a0060debf2cead, server=jenkins-hbase4.apache.org,37883,1696539600708 in 176 msec 2023-10-05 21:00:40,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-05 21:00:40,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure c82741b5c3728ffab4248b35183c1411, server=jenkins-hbase4.apache.org,34111,1696539600754 in 176 msec 2023-10-05 21:00:40,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, ASSIGN in 338 msec 2023-10-05 21:00:40,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-05 21:00:40,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, ASSIGN in 340 msec 2023-10-05 21:00:40,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:00:40,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539640748"}]},"ts":"1696539640748"} 2023-10-05 21:00:40,750 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-05 21:00:40,753 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:00:40,753 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-05 21:00:40,755 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 21:00:40,757 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,757 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,757 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,757 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:00:40,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:40,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:40,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:40,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 21:00:40,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 413 msec 2023-10-05 21:00:40,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 21:00:40,954 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-05 21:00:40,957 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 21:00:40,957 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:40,960 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:40,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 21:00:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539640971 (current time:1696539640971). 2023-10-05 21:00:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:00:40,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x1e45cb52 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:40,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47be31c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:40,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:40,983 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:40,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e45cb52 to 127.0.0.1:54534 2023-10-05 21:00:40,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:40,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x4b45614b to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:40,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bea2c2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:40,996 DEBUG [hconnection-0x20d25348-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:40,998 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:41,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b45614b to 127.0.0.1:54534 2023-10-05 21:00:41,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:41,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 21:00:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:00:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 21:00:41,006 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:00:41,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 21:00:41,009 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 21:00:41,009 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696540241009 2023-10-05 21:00:41,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 21:00:41,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 21:00:41,010 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:00:41,011 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:00:41,012 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 21:00:41,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 21:00:41,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-05 21:00:41,014 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 21:00:41,015 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696540241015 2023-10-05 21:00:41,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,027 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-05 21:00:41,027 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,028 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 21:00:41,028 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 21:00:41,028 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,028 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,030 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,030 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,030 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,030 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,030 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,031 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,031 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,031 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:00:41,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 21:00:41,032 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 21:00:41,032 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 21:00:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 21:00:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 21:00:41,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 21:00:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 21:00:41,034 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,034 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 21:00:41,037 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 21:00:41,037 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 21:00:41,037 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 21:00:41,038 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 21:00:41,037 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 21:00:41,039 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,040 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,040 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,040 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15d07eed[Count = 1] remaining members to acquire global barrier 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 21:00:41,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15d07eed[Count = 0] remaining members to acquire global barrier 2023-10-05 21:00:41,044 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 21:00:41,044 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,045 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,045 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,045 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 21:00:41,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 21:00:41,046 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,046 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. started... 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 21:00:41,046 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:41,046 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:41,046 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,047 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:00:41,046 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c82741b5c3728ffab4248b35183c1411: 2023-10-05 21:00:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:00:41,046 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. started... 2023-10-05 21:00:41,047 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,048 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:41,048 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b576fc79ba0b58c7d3a0060debf2cead: 2023-10-05 21:00:41,048 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:00:41,049 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,049 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:41,049 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:00:41,056 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 21:00:41,056 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,056 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 21:00:41,072 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. completed. 2023-10-05 21:00:41,072 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. completed. 2023-10-05 21:00:41,072 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:41,072 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:00:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 21:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 21:00:41,074 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 21:00:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,077 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 21:00:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34111,1696539600754': 2023-10-05 21:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 21:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:00:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 21:00:41,085 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-05 21:00:41,085 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:00:41,085 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:00:41,085 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,085 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:00:41,087 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,087 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,087 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,088 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,088 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,088 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,089 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,091 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,091 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,092 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,096 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,096 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,098 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 21:00:41,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,097 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:00:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,098 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,098 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,098 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 21:00:41,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,111 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:41,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 21:00:41,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:41,112 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:00:41,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 21:00:41,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,128 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 21:00:41,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696539641009Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696539641107 (+98 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696539641107Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696539641107Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696539641113 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696539641121 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696539641128 (+7 ms) 2023-10-05 21:00:41,133 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 21:00:41,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 123 msec 2023-10-05 21:00:41,312 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:41,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 21:00:41,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:00:41,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34111] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:00:41,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37883] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:00:41,322 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 21:00:41,322 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:41,322 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:00:41,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 21:00:41,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539641334 (current time:1696539641334). 2023-10-05 21:00:41,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:00:41,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x57e6fe8e to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:41,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50281840, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:41,352 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:41,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57e6fe8e to 127.0.0.1:54534 2023-10-05 21:00:41,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:41,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x46b2bb92 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:00:41,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26402f44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:00:41,365 DEBUG [hconnection-0x36bac9d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:00:41,367 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:00:41,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46b2bb92 to 127.0.0.1:54534 2023-10-05 21:00:41,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:00:41,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 21:00:41,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:00:41,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 21:00:41,377 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:00:41,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 21:00:41,379 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 21:00:41,380 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696540241380 2023-10-05 21:00:41,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 21:00:41,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 21:00:41,381 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:00:41,381 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:00:41,382 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 21:00:41,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 21:00:41,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-05 21:00:41,384 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 21:00:41,385 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696540241385 2023-10-05 21:00:41,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-05 21:00:41,396 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-05 21:00:41,396 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,397 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 21:00:41,397 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 21:00:41,398 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,398 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,400 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,400 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,400 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,400 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,400 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,400 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 21:00:41,404 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 21:00:41,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 21:00:41,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 21:00:41,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 21:00:41,404 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 21:00:41,404 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 21:00:41,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 21:00:41,404 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,404 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 21:00:41,405 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 21:00:41,405 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 21:00:41,405 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,404 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:00:41,406 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 21:00:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 21:00:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 21:00:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 21:00:41,405 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 21:00:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 21:00:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 21:00:41,409 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,409 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,409 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,409 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,409 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,410 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,410 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:41,410 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,410 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:41,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,410 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,410 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:00:41,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@195b4e84[Count = 1] remaining members to acquire global barrier 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 21:00:41,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@195b4e84[Count = 0] remaining members to acquire global barrier 2023-10-05 21:00:41,415 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 21:00:41,415 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,417 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 21:00:41,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 21:00:41,417 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,417 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 21:00:41,417 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:00:41,417 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:41,417 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. started... 2023-10-05 21:00:41,417 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:00:41,418 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. started... 2023-10-05 21:00:41,418 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c82741b5c3728ffab4248b35183c1411 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-05 21:00:41,418 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b576fc79ba0b58c7d3a0060debf2cead 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-05 21:00:41,420 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 21:00:41,420 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,420 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 21:00:41,452 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005e61e11991fb14cc188bf44be83bf30a8 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005e61e11991fb14cc188bf44be83bf30a8 2023-10-05 21:00:41,463 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100566eb64af740f4060b65a1a3e5624b85c to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100566eb64af740f4060b65a1a3e5624b85c 2023-10-05 21:00:41,475 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/.tmp/cf/e58cf1892bb54827a89493049fae1a39 2023-10-05 21:00:41,481 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:41,482 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/.tmp/cf/e58cf1892bb54827a89493049fae1a39 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf/e58cf1892bb54827a89493049fae1a39 2023-10-05 21:00:41,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 21:00:41,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:00:41,483 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:00:41,484 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/.tmp/cf/90344ce0fee0400db906cece21b5789f 2023-10-05 21:00:41,489 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf/e58cf1892bb54827a89493049fae1a39, entries=45, sequenceid=6, filesize=12.4 K 2023-10-05 21:00:41,489 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/.tmp/cf/90344ce0fee0400db906cece21b5789f as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf/90344ce0fee0400db906cece21b5789f 2023-10-05 21:00:41,490 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b576fc79ba0b58c7d3a0060debf2cead in 72ms, sequenceid=6, compaction requested=false 2023-10-05 21:00:41,490 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 21:00:41,491 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b576fc79ba0b58c7d3a0060debf2cead: 2023-10-05 21:00:41,491 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 21:00:41,491 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:41,491 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf/e58cf1892bb54827a89493049fae1a39] hfiles 2023-10-05 21:00:41,491 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf/e58cf1892bb54827a89493049fae1a39 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 21:00:41,495 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf/90344ce0fee0400db906cece21b5789f, entries=5, sequenceid=6, filesize=5.7 K 2023-10-05 21:00:41,496 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c82741b5c3728ffab4248b35183c1411 in 78ms, sequenceid=6, compaction requested=false 2023-10-05 21:00:41,498 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c82741b5c3728ffab4248b35183c1411: 2023-10-05 21:00:41,499 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 21:00:41,499 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:00:41,499 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf/90344ce0fee0400db906cece21b5789f] hfiles 2023-10-05 21:00:41,499 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf/90344ce0fee0400db906cece21b5789f for snapshot=snaptb0-testConsecutiveExports 2023-10-05 21:00:41,509 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. completed. 2023-10-05 21:00:41,509 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:00:41,509 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:41,509 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:41,509 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,509 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 21:00:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:00:41,512 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 21:00:41,512 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,512 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,512 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 21:00:41,514 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. completed. 2023-10-05 21:00:41,514 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:00:41,514 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:00:41,514 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:00:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,514 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,515 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 21:00:41,515 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:00:41,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,516 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 21:00:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,516 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,516 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,517 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 21:00:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34111,1696539600754': 2023-10-05 21:00:41,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 21:00:41,523 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-05 21:00:41,523 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:00:41,523 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:00:41,523 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-05 21:00:41,523 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:00:41,525 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,525 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,525 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,525 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:00:41,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,525 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:00:41,525 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,526 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,527 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:00:41,528 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:00:41,530 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 21:00:41,531 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,531 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,540 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:00:41,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,539 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:00:41,540 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-05 21:00:41,540 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:00:41,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 21:00:41,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:00:41,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:00:41,540 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,542 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005e61e11991fb14cc188bf44be83bf30a8, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100566eb64af740f4060b65a1a3e5624b85c] mob files 2023-10-05 21:00:41,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005e61e11991fb14cc188bf44be83bf30a8 2023-10-05 21:00:41,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100566eb64af740f4060b65a1a3e5624b85c 2023-10-05 21:00:41,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-05 21:00:41,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,585 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 21:00:41,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,586 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696539641380Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696539641555 (+175 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696539641555Loading Region manifests for snaptb0-testConsecutiveExports at 1696539641555Writing data manifest for snaptb0-testConsecutiveExports at 1696539641565 (+10 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696539641577 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696539641585 (+8 ms) 2023-10-05 21:00:41,588 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 21:00:41,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 207 msec 2023-10-05 21:00:41,683 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:00:41,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 21:00:41,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:00:41,685 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685 2023-10-05 21:00:41,685 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:41,707 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:41,707 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@73e32fb4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,707 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 21:00:41,715 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:41,728 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,729 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,729 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,730 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,730 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,731 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,731 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,812 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-2767248081512461874.jar 2023-10-05 21:00:41,812 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,813 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,813 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,813 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,814 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,814 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:41,814 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:00:41,815 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:00:41,815 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:00:41,816 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:00:41,816 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:00:41,816 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:00:41,817 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:00:41,817 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:00:41,817 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:00:41,818 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:00:41,818 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:41,819 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:41,819 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:41,819 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:41,819 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:41,820 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:41,820 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:42,213 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:00:42,215 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 21:00:42,218 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 21:00:44,254 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:44,254 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:44,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0002_000001 (auth:SIMPLE) 2023-10-05 21:00:44,548 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0003_000001 (auth:SIMPLE) 2023-10-05 21:00:45,611 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:00:48,384 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0003_000001 (auth:SIMPLE) 2023-10-05 21:00:50,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0003_000001 (auth:SIMPLE) 2023-10-05 21:00:53,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0003_000001 (auth:SIMPLE) 2023-10-05 21:00:54,392 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:00:54,392 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:00:54,396 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 21:00:54,396 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:00:54,397 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:00:54,397 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 21:00:54,400 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 21:00:54,400 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 21:00:54,401 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5658b57b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 21:00:54,401 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 21:00:54,401 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 21:00:54,403 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:54,436 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:00:54,436 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7897330c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:54,436 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 21:00:54,451 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 21:00:54,472 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,473 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,473 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,473 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,474 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,474 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,474 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,547 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-2090319606513296571.jar 2023-10-05 21:00:54,548 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,548 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,549 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,549 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,549 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,550 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:00:54,550 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:00:54,551 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:00:54,551 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:00:54,551 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:00:54,552 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:00:54,552 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:00:54,552 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:00:54,553 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:00:54,553 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:00:54,554 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:00:54,554 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:54,555 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:54,555 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:54,556 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:54,556 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:00:54,557 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:54,557 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:00:54,957 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:00:54,959 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 21:00:54,962 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 21:00:59,248 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:59,249 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:00:59,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0003_000001 (auth:SIMPLE) 2023-10-05 21:00:59,264 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0004_000001 (auth:SIMPLE) 2023-10-05 21:01:02,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0004_000001 (auth:SIMPLE) 2023-10-05 21:01:05,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0004_000001 (auth:SIMPLE) 2023-10-05 21:01:07,810 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0004_000001 (auth:SIMPLE) 2023-10-05 21:01:09,151 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:01:09,152 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:01:09,155 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 21:01:09,155 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:01:09,156 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:01:09,156 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 21:01:09,158 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 21:01:09,158 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 21:01:09,159 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5658b57b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 21:01:09,159 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 21:01:09,159 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/local-export-1696539641685/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 21:01:09,171 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-05 21:01:09,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-05 21:01:09,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 21:01:09,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539669176"}]},"ts":"1696539669176"} 2023-10-05 21:01:09,177 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-05 21:01:09,179 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-05 21:01:09,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, UNASSIGN}] 2023-10-05 21:01:09,182 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, UNASSIGN 2023-10-05 21:01:09,182 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, UNASSIGN 2023-10-05 21:01:09,183 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b576fc79ba0b58c7d3a0060debf2cead, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:09,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c82741b5c3728ffab4248b35183c1411, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:09,183 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539669183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539669183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539669183"}]},"ts":"1696539669183"} 2023-10-05 21:01:09,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539669183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539669183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539669183"}]},"ts":"1696539669183"} 2023-10-05 21:01:09,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure b576fc79ba0b58c7d3a0060debf2cead, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:09,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure c82741b5c3728ffab4248b35183c1411, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:01:09,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 21:01:09,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:01:09,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b576fc79ba0b58c7d3a0060debf2cead, disabling compactions & flushes 2023-10-05 21:01:09,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:01:09,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:01:09,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. after waiting 0 ms 2023-10-05 21:01:09,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:01:09,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c82741b5c3728ffab4248b35183c1411 2023-10-05 21:01:09,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c82741b5c3728ffab4248b35183c1411, disabling compactions & flushes 2023-10-05 21:01:09,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:01:09,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:01:09,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. after waiting 0 ms 2023-10-05 21:01:09,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:01:09,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:09,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:09,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:09,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead. 2023-10-05 21:01:09,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b576fc79ba0b58c7d3a0060debf2cead: 2023-10-05 21:01:09,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:09,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411. 2023-10-05 21:01:09,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c82741b5c3728ffab4248b35183c1411: 2023-10-05 21:01:09,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:01:09,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b576fc79ba0b58c7d3a0060debf2cead, regionState=CLOSED 2023-10-05 21:01:09,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c82741b5c3728ffab4248b35183c1411 2023-10-05 21:01:09,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539669352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539669352"}]},"ts":"1696539669352"} 2023-10-05 21:01:09,352 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c82741b5c3728ffab4248b35183c1411, regionState=CLOSED 2023-10-05 21:01:09,352 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696539669352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539669352"}]},"ts":"1696539669352"} 2023-10-05 21:01:09,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-10-05 21:01:09,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure b576fc79ba0b58c7d3a0060debf2cead, server=jenkins-hbase4.apache.org,37883,1696539600708 in 169 msec 2023-10-05 21:01:09,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-10-05 21:01:09,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure c82741b5c3728ffab4248b35183c1411, server=jenkins-hbase4.apache.org,34111,1696539600754 in 169 msec 2023-10-05 21:01:09,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b576fc79ba0b58c7d3a0060debf2cead, UNASSIGN in 175 msec 2023-10-05 21:01:09,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-05 21:01:09,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c82741b5c3728ffab4248b35183c1411, UNASSIGN in 176 msec 2023-10-05 21:01:09,358 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539669358"}]},"ts":"1696539669358"} 2023-10-05 21:01:09,360 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-05 21:01:09,362 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-05 21:01:09,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 192 msec 2023-10-05 21:01:09,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 21:01:09,478 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-05 21:01:09,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-05 21:01:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,482 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-05 21:01:09,483 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,485 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-05 21:01:09,488 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,488 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,488 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,488 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,488 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 2023-10-05 21:01:09,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 21:01:09,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 21:01:09,489 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:01:09,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 21:01:09,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:09,490 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:09,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 21:01:09,491 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/recovered.edits] 2023-10-05 21:01:09,491 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/recovered.edits] 2023-10-05 21:01:09,497 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf/90344ce0fee0400db906cece21b5789f to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/cf/90344ce0fee0400db906cece21b5789f 2023-10-05 21:01:09,497 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf/e58cf1892bb54827a89493049fae1a39 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/cf/e58cf1892bb54827a89493049fae1a39 2023-10-05 21:01:09,500 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411/recovered.edits/9.seqid 2023-10-05 21:01:09,500 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead/recovered.edits/9.seqid 2023-10-05 21:01:09,501 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/c82741b5c3728ffab4248b35183c1411 2023-10-05 21:01:09,501 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testConsecutiveExports/b576fc79ba0b58c7d3a0060debf2cead 2023-10-05 21:01:09,501 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 21:01:09,501 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 21:01:09,502 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-05 21:01:09,505 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005e61e11991fb14cc188bf44be83bf30a8 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005e61e11991fb14cc188bf44be83bf30a8 2023-10-05 21:01:09,507 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100566eb64af740f4060b65a1a3e5624b85c to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100566eb64af740f4060b65a1a3e5624b85c 2023-10-05 21:01:09,507 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 21:01:09,509 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,512 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-05 21:01:09,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-05 21:01:09,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-05 21:01:09,514 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539669514"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:09,515 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539669514"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:09,516 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 21:01:09,516 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c82741b5c3728ffab4248b35183c1411, NAME => 'testtb-testConsecutiveExports,,1696539640344.c82741b5c3728ffab4248b35183c1411.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b576fc79ba0b58c7d3a0060debf2cead, NAME => 'testtb-testConsecutiveExports,1,1696539640344.b576fc79ba0b58c7d3a0060debf2cead.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 21:01:09,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-05 21:01:09,516 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539669516"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:09,518 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-05 21:01:09,521 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 21:01:09,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-10-05 21:01:09,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 21:01:09,592 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-05 21:01:09,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-05 21:01:09,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-05 21:01:09,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-05 21:01:09,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-05 21:01:09,628 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=756 (was 765), OpenFileDescriptor=919 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 277), ProcessCount=168 (was 168), AvailableMemoryMB=5708 (was 5921) 2023-10-05 21:01:09,628 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-10-05 21:01:09,647 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=168, AvailableMemoryMB=5707 2023-10-05 21:01:09,647 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-10-05 21:01:09,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 21:01:09,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:09,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:01:09,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-05 21:01:09,653 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:01:09,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 21:01:09,655 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:09,655 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:09,656 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f empty. 2023-10-05 21:01:09,656 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 empty. 2023-10-05 21:01:09,656 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:09,656 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:09,656 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 21:01:09,667 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-05 21:01:09,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 18ab65e029f773f324bc62d515124c7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:09,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c0458535c508aa78e87aed3f5e918ec1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:09,678 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:09,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 18ab65e029f773f324bc62d515124c7f, disabling compactions & flushes 2023-10-05 21:01:09,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:09,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:09,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. after waiting 0 ms 2023-10-05 21:01:09,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:09,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:09,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 18ab65e029f773f324bc62d515124c7f: 2023-10-05 21:01:09,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 21:01:09,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 21:01:10,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:10,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c0458535c508aa78e87aed3f5e918ec1, disabling compactions & flushes 2023-10-05 21:01:10,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. after waiting 0 ms 2023-10-05 21:01:10,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c0458535c508aa78e87aed3f5e918ec1: 2023-10-05 21:01:10,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:01:10,084 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539670083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539670083"}]},"ts":"1696539670083"} 2023-10-05 21:01:10,084 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539670083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539670083"}]},"ts":"1696539670083"} 2023-10-05 21:01:10,090 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:01:10,091 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:01:10,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539670091"}]},"ts":"1696539670091"} 2023-10-05 21:01:10,092 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-05 21:01:10,095 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:01:10,096 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:01:10,096 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:01:10,096 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:01:10,096 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:01:10,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, ASSIGN}] 2023-10-05 21:01:10,098 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, ASSIGN 2023-10-05 21:01:10,098 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, ASSIGN 2023-10-05 21:01:10,099 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34111,1696539600754; forceNewPlan=false, retain=false 2023-10-05 21:01:10,099 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37883,1696539600708; forceNewPlan=false, retain=false 2023-10-05 21:01:10,249 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:01:10,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=18ab65e029f773f324bc62d515124c7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c0458535c508aa78e87aed3f5e918ec1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539670252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539670252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539670252"}]},"ts":"1696539670252"} 2023-10-05 21:01:10,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539670252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539670252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539670252"}]},"ts":"1696539670252"} 2023-10-05 21:01:10,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 18ab65e029f773f324bc62d515124c7f, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:10,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c0458535c508aa78e87aed3f5e918ec1, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:01:10,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 21:01:10,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18ab65e029f773f324bc62d515124c7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. service=AccessControlService 2023-10-05 21:01:10,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c0458535c508aa78e87aed3f5e918ec1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. service=AccessControlService 2023-10-05 21:01:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,414 INFO [StoreOpener-18ab65e029f773f324bc62d515124c7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,414 INFO [StoreOpener-c0458535c508aa78e87aed3f5e918ec1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,416 DEBUG [StoreOpener-18ab65e029f773f324bc62d515124c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf 2023-10-05 21:01:10,416 DEBUG [StoreOpener-18ab65e029f773f324bc62d515124c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf 2023-10-05 21:01:10,416 DEBUG [StoreOpener-c0458535c508aa78e87aed3f5e918ec1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf 2023-10-05 21:01:10,416 DEBUG [StoreOpener-c0458535c508aa78e87aed3f5e918ec1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf 2023-10-05 21:01:10,417 INFO [StoreOpener-18ab65e029f773f324bc62d515124c7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ab65e029f773f324bc62d515124c7f columnFamilyName cf 2023-10-05 21:01:10,417 INFO [StoreOpener-c0458535c508aa78e87aed3f5e918ec1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0458535c508aa78e87aed3f5e918ec1 columnFamilyName cf 2023-10-05 21:01:10,419 INFO [StoreOpener-c0458535c508aa78e87aed3f5e918ec1-1] regionserver.HStore(310): Store=c0458535c508aa78e87aed3f5e918ec1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:10,419 INFO [StoreOpener-18ab65e029f773f324bc62d515124c7f-1] regionserver.HStore(310): Store=18ab65e029f773f324bc62d515124c7f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:10,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:10,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:10,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:10,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c0458535c508aa78e87aed3f5e918ec1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63601566, jitterRate=-0.0522628128528595}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:10,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:10,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c0458535c508aa78e87aed3f5e918ec1: 2023-10-05 21:01:10,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18ab65e029f773f324bc62d515124c7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65162162, jitterRate=-0.02900812029838562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:10,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18ab65e029f773f324bc62d515124c7f: 2023-10-05 21:01:10,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1., pid=61, masterSystemTime=1696539670407 2023-10-05 21:01:10,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f., pid=60, masterSystemTime=1696539670406 2023-10-05 21:01:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c0458535c508aa78e87aed3f5e918ec1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,428 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539670428"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539670428"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539670428"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539670428"}]},"ts":"1696539670428"} 2023-10-05 21:01:10,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:10,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:10,429 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=18ab65e029f773f324bc62d515124c7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539670429"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539670429"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539670429"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539670429"}]},"ts":"1696539670429"} 2023-10-05 21:01:10,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-05 21:01:10,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c0458535c508aa78e87aed3f5e918ec1, server=jenkins-hbase4.apache.org,34111,1696539600754 in 175 msec 2023-10-05 21:01:10,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-05 21:01:10,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 18ab65e029f773f324bc62d515124c7f, server=jenkins-hbase4.apache.org,37883,1696539600708 in 177 msec 2023-10-05 21:01:10,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, ASSIGN in 336 msec 2023-10-05 21:01:10,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-05 21:01:10,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, ASSIGN in 338 msec 2023-10-05 21:01:10,436 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:01:10,436 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539670436"}]},"ts":"1696539670436"} 2023-10-05 21:01:10,437 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-05 21:01:10,440 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:01:10,440 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-05 21:01:10,442 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 21:01:10,444 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:10,444 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:10,444 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:10,444 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:10,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:10,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:10,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:10,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:10,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 797 msec 2023-10-05 21:01:10,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 21:01:10,761 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-05 21:01:10,764 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,764 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:10,765 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:01:10,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 21:01:10,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539670778 (current time:1696539670778). 2023-10-05 21:01:10,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:10,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x41a31ee8 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:10,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d3053af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:10,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:10,788 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:10,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41a31ee8 to 127.0.0.1:54534 2023-10-05 21:01:10,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:10,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x4296886f to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:10,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b9b9a8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:10,797 DEBUG [hconnection-0x74d90f7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:10,798 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:10,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4296886f to 127.0.0.1:54534 2023-10-05 21:01:10,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:10,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 21:01:10,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:10,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 21:01:10,808 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:10,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 21:01:10,810 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 21:01:10,810 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696540270810 2023-10-05 21:01:10,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 21:01:10,812 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:10,812 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:10,813 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 21:01:10,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 21:01:10,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 21:01:10,814 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 21:01:10,815 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696540270815 2023-10-05 21:01:10,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,825 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 21:01:10,825 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:10,826 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 21:01:10,826 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 21:01:10,826 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,826 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,828 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:10,828 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:10,828 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:10,828 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:10,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:10,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:10,828 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,828 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,829 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 21:01:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,830 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 21:01:10,830 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 21:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,830 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:10,830 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 21:01:10,831 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 21:01:10,831 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:10,831 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 21:01:10,830 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:10,832 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 21:01:10,832 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 21:01:10,833 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 21:01:10,833 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 21:01:10,833 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 21:01:10,833 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 21:01:10,833 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 21:01:10,834 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,836 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,836 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:10,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51b1f21b[Count = 1] remaining members to acquire global barrier 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:10,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 21:01:10,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51b1f21b[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:10,841 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 21:01:10,841 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,842 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 21:01:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 21:01:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 21:01:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:10,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:10,843 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,843 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 21:01:10,843 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,843 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. started... 2023-10-05 21:01:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:10,843 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. started... 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c0458535c508aa78e87aed3f5e918ec1: 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18ab65e029f773f324bc62d515124c7f: 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:01:10,844 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:01:10,853 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 21:01:10,853 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:10,853 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 21:01:10,880 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. completed. 2023-10-05 21:01:10,880 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,880 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. completed. 2023-10-05 21:01:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 21:01:10,880 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:10,881 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:10,881 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,881 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 21:01:10,881 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:10,892 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 21:01:10,892 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,893 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:10,893 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 21:01:10,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:10,901 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:10,901 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 21:01:10,901 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:10,901 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 21:01:10,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:10,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:01:10,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 21:01:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34111,1696539600754': 2023-10-05 21:01:10,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 21:01:10,908 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 21:01:10,909 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:10,909 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:10,909 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,909 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:10,912 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:10,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 21:01:10,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:01:10,913 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:10,915 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:10,916 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:10,917 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:10,917 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:10,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,919 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,920 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,920 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,925 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:10,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:10,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:10,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,926 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:10,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:10,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:10,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:10,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,926 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:10,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:01:10,928 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:10,928 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:10,928 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,928 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:10,929 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:10,929 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,929 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 21:01:10,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 21:01:10,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,965 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:10,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696539670811Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696539670943 (+132 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696539670943Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696539670944 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696539670948 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696539670957 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696539670964 (+7 ms) 2023-10-05 21:01:10,968 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 21:01:10,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 157 msec 2023-10-05 21:01:11,113 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:11,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 21:01:11,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:11,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:01:11,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34111] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:01:11,120 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,120 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:11,120 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:01:11,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 21:01:11,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539671131 (current time:1696539671131). 2023-10-05 21:01:11,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:11,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc0ff7b to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:11,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5088e480, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:11,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:11,142 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:11,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc0ff7b to 127.0.0.1:54534 2023-10-05 21:01:11,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:11,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x69d3a140 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:11,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1293a026, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:11,150 DEBUG [hconnection-0x5a8fa10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:11,152 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:11,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69d3a140 to 127.0.0.1:54534 2023-10-05 21:01:11,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:11,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 21:01:11,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:11,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 21:01:11,160 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:11,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 21:01:11,162 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 21:01:11,162 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696540271162 2023-10-05 21:01:11,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 21:01:11,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,164 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:11,164 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:11,165 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 21:01:11,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 21:01:11,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 21:01:11,166 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 21:01:11,167 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696540271167 2023-10-05 21:01:11,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,175 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 21:01:11,175 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:11,176 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 21:01:11,176 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 21:01:11,176 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,176 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,178 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:11,178 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,178 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:11,178 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:11,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:11,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:11,179 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:11,179 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,179 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,179 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 21:01:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 21:01:11,181 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 21:01:11,181 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 21:01:11,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,181 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 21:01:11,181 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 21:01:11,181 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:11,181 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:11,182 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 21:01:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 21:01:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 21:01:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 21:01:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 21:01:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 21:01:11,184 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,184 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:11,185 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,187 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@961b3c0[Count = 1] remaining members to acquire global barrier 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:11,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 21:01:11,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@961b3c0[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:11,191 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 21:01:11,191 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,192 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 21:01:11,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,192 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,192 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 21:01:11,192 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:11,192 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:11,192 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 21:01:11,193 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. started... 2023-10-05 21:01:11,193 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:11,192 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:11,193 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:11,193 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. started... 2023-10-05 21:01:11,193 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c0458535c508aa78e87aed3f5e918ec1 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 21:01:11,193 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 21:01:11,193 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18ab65e029f773f324bc62d515124c7f 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 21:01:11,193 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:11,193 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:11,193 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:11,194 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 21:01:11,195 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:11,195 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 21:01:11,211 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005d2ce337b73dd45e1a26e806eb0322598 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005d2ce337b73dd45e1a26e806eb0322598 2023-10-05 21:01:11,212 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310051653097c3a0942dfbdbf5b0e4422b09f to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310051653097c3a0942dfbdbf5b0e4422b09f 2023-10-05 21:01:11,219 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/.tmp/cf/769c6ec2b1dd4c17b36ee35382457512 2023-10-05 21:01:11,220 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/.tmp/cf/f74f06a1e01241bdbe13950dcae888c7 2023-10-05 21:01:11,224 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/.tmp/cf/769c6ec2b1dd4c17b36ee35382457512 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf/769c6ec2b1dd4c17b36ee35382457512 2023-10-05 21:01:11,224 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/.tmp/cf/f74f06a1e01241bdbe13950dcae888c7 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf/f74f06a1e01241bdbe13950dcae888c7 2023-10-05 21:01:11,229 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf/f74f06a1e01241bdbe13950dcae888c7, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 21:01:11,229 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf/769c6ec2b1dd4c17b36ee35382457512, entries=46, sequenceid=6, filesize=13.3 K 2023-10-05 21:01:11,230 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 18ab65e029f773f324bc62d515124c7f in 37ms, sequenceid=6, compaction requested=false 2023-10-05 21:01:11,230 INFO [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c0458535c508aa78e87aed3f5e918ec1 in 37ms, sequenceid=6, compaction requested=false 2023-10-05 21:01:11,230 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 21:01:11,230 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18ab65e029f773f324bc62d515124c7f: 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c0458535c508aa78e87aed3f5e918ec1: 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf/f74f06a1e01241bdbe13950dcae888c7] hfiles 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf/769c6ec2b1dd4c17b36ee35382457512] hfiles 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf/769c6ec2b1dd4c17b36ee35382457512 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,233 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf/f74f06a1e01241bdbe13950dcae888c7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,240 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. completed. 2023-10-05 21:01:11,240 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,240 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. completed. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 21:01:11,240 DEBUG [rs(jenkins-hbase4.apache.org,34111,1696539600754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 21:01:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:11,242 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,242 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 21:01:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:11,242 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:11,242 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 21:01:11,244 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 21:01:11,244 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:11,244 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,244 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 21:01:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34111,1696539600754': 2023-10-05 21:01:11,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 21:01:11,252 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 21:01:11,252 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:11,252 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:11,252 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,252 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:11,256 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,256 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,256 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:11,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,256 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,256 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:11,257 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:11,257 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:11,257 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:11,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:11,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:11,258 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:11,258 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:11,259 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,260 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,260 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,262 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,263 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:11,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:11,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:11,264 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:11,264 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:11,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:11,264 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:11,263 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,265 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:11,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:11,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:01:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:11,265 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:11,265 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:11,265 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:11,265 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,265 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:11,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 21:01:11,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:01:11,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310051653097c3a0942dfbdbf5b0e4422b09f, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005d2ce337b73dd45e1a26e806eb0322598] mob files 2023-10-05 21:01:11,266 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:01:11,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310051653097c3a0942dfbdbf5b0e4422b09f 2023-10-05 21:01:11,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005d2ce337b73dd45e1a26e806eb0322598 2023-10-05 21:01:11,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 21:01:11,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,301 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:11,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696539671163Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696539671272 (+109 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696539671272Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696539671273 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696539671276 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696539671293 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696539671301 (+8 ms) 2023-10-05 21:01:11,304 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 21:01:11,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 141 msec 2023-10-05 21:01:11,466 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:11,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 21:01:11,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:11,494 DEBUG [Listener at jenkins-hbase4.apache.org/40083] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 21:01:11,500 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 21:01:11,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34111] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 21:01:11,502 DEBUG [Listener at jenkins-hbase4.apache.org/40083] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 21:01:11,505 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 21:01:11,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35295] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 21:01:11,505 DEBUG [Listener at jenkins-hbase4.apache.org/40083] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 21:01:11,507 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 21:01:11,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37883] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 21:01:11,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 21:01:11,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:11,512 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:01:11,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-05 21:01:11,513 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:01:11,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 21:01:11,516 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,516 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,516 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d empty. 2023-10-05 21:01:11,516 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 empty. 2023-10-05 21:01:11,517 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,517 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 21:01:11,526 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-05 21:01:11,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1259376c640005de6681c212a1eae45d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:11,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9278c379ce7fc3face94ec9c35be6d79, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:11,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:11,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:11,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9278c379ce7fc3face94ec9c35be6d79, disabling compactions & flushes 2023-10-05 21:01:11,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 1259376c640005de6681c212a1eae45d, disabling compactions & flushes 2023-10-05 21:01:11,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. after waiting 0 ms 2023-10-05 21:01:11,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. after waiting 0 ms 2023-10-05 21:01:11,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,538 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,538 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9278c379ce7fc3face94ec9c35be6d79: 2023-10-05 21:01:11,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 1259376c640005de6681c212a1eae45d: 2023-10-05 21:01:11,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:01:11,541 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539671541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539671541"}]},"ts":"1696539671541"} 2023-10-05 21:01:11,541 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539671541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539671541"}]},"ts":"1696539671541"} 2023-10-05 21:01:11,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:01:11,543 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:01:11,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539671543"}]},"ts":"1696539671543"} 2023-10-05 21:01:11,545 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-05 21:01:11,548 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:01:11,549 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:01:11,549 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:01:11,550 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:01:11,550 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:01:11,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, ASSIGN}] 2023-10-05 21:01:11,552 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, ASSIGN 2023-10-05 21:01:11,552 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, ASSIGN 2023-10-05 21:01:11,553 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34111,1696539600754; forceNewPlan=false, retain=false 2023-10-05 21:01:11,553 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:01:11,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 21:01:11,703 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:01:11,706 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9278c379ce7fc3face94ec9c35be6d79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,706 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1259376c640005de6681c212a1eae45d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,706 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539671706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539671706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539671706"}]},"ts":"1696539671706"} 2023-10-05 21:01:11,706 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539671706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539671706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539671706"}]},"ts":"1696539671706"} 2023-10-05 21:01:11,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 9278c379ce7fc3face94ec9c35be6d79, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:01:11,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 1259376c640005de6681c212a1eae45d, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:11,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 21:01:11,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9278c379ce7fc3face94ec9c35be6d79, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.', STARTKEY => '2', ENDKEY => ''} 2023-10-05 21:01:11,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. service=AccessControlService 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1259376c640005de6681c212a1eae45d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.', STARTKEY => '', ENDKEY => '2'} 2023-10-05 21:01:11,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. service=AccessControlService 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:11,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,866 INFO [StoreOpener-9278c379ce7fc3face94ec9c35be6d79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,867 INFO [StoreOpener-1259376c640005de6681c212a1eae45d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,868 DEBUG [StoreOpener-9278c379ce7fc3face94ec9c35be6d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf 2023-10-05 21:01:11,868 DEBUG [StoreOpener-9278c379ce7fc3face94ec9c35be6d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf 2023-10-05 21:01:11,868 DEBUG [StoreOpener-1259376c640005de6681c212a1eae45d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf 2023-10-05 21:01:11,868 DEBUG [StoreOpener-1259376c640005de6681c212a1eae45d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf 2023-10-05 21:01:11,868 INFO [StoreOpener-9278c379ce7fc3face94ec9c35be6d79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9278c379ce7fc3face94ec9c35be6d79 columnFamilyName cf 2023-10-05 21:01:11,868 INFO [StoreOpener-1259376c640005de6681c212a1eae45d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1259376c640005de6681c212a1eae45d columnFamilyName cf 2023-10-05 21:01:11,869 INFO [StoreOpener-9278c379ce7fc3face94ec9c35be6d79-1] regionserver.HStore(310): Store=9278c379ce7fc3face94ec9c35be6d79/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:11,869 INFO [StoreOpener-1259376c640005de6681c212a1eae45d-1] regionserver.HStore(310): Store=1259376c640005de6681c212a1eae45d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:11,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:11,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:11,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:11,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9278c379ce7fc3face94ec9c35be6d79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75383642, jitterRate=0.12330380082130432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:11,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9278c379ce7fc3face94ec9c35be6d79: 2023-10-05 21:01:11,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:11,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79., pid=69, masterSystemTime=1696539671859 2023-10-05 21:01:11,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1259376c640005de6681c212a1eae45d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68405629, jitterRate=0.019323304295539856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:11,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1259376c640005de6681c212a1eae45d: 2023-10-05 21:01:11,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d., pid=70, masterSystemTime=1696539671860 2023-10-05 21:01:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:11,877 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9278c379ce7fc3face94ec9c35be6d79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:11,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:11,877 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539671877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539671877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539671877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539671877"}]},"ts":"1696539671877"} 2023-10-05 21:01:11,878 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1259376c640005de6681c212a1eae45d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:11,878 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539671877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539671877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539671877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539671877"}]},"ts":"1696539671877"} 2023-10-05 21:01:11,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-05 21:01:11,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 9278c379ce7fc3face94ec9c35be6d79, server=jenkins-hbase4.apache.org,34111,1696539600754 in 171 msec 2023-10-05 21:01:11,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, ASSIGN in 330 msec 2023-10-05 21:01:11,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-05 21:01:11,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 1259376c640005de6681c212a1eae45d, server=jenkins-hbase4.apache.org,35295,1696539600793 in 172 msec 2023-10-05 21:01:11,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-05 21:01:11,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, ASSIGN in 332 msec 2023-10-05 21:01:11,884 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:01:11,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539671884"}]},"ts":"1696539671884"} 2023-10-05 21:01:11,886 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-05 21:01:11,888 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:01:11,888 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-05 21:01:11,890 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 21:01:11,892 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:11,892 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:11,892 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:11,892 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:11,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:11,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 384 msec 2023-10-05 21:01:12,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 21:01:12,116 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-05 21:01:12,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 1259376c640005de6681c212a1eae45d, 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:12,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1259376c640005de6681c212a1eae45d, 9278c379ce7fc3face94ec9c35be6d79], force=true 2023-10-05 21:01:12,154 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1259376c640005de6681c212a1eae45d, 9278c379ce7fc3face94ec9c35be6d79], force=true 2023-10-05 21:01:12,154 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1259376c640005de6681c212a1eae45d, 9278c379ce7fc3face94ec9c35be6d79], force=true 2023-10-05 21:01:12,154 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1259376c640005de6681c212a1eae45d, 9278c379ce7fc3face94ec9c35be6d79], force=true 2023-10-05 21:01:12,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 21:01:12,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, UNASSIGN}] 2023-10-05 21:01:12,183 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, UNASSIGN 2023-10-05 21:01:12,183 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, UNASSIGN 2023-10-05 21:01:12,184 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9278c379ce7fc3face94ec9c35be6d79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:12,184 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1259376c640005de6681c212a1eae45d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:12,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539672184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539672184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539672184"}]},"ts":"1696539672184"} 2023-10-05 21:01:12,184 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539672184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539672184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539672184"}]},"ts":"1696539672184"} 2023-10-05 21:01:12,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 9278c379ce7fc3face94ec9c35be6d79, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:01:12,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 1259376c640005de6681c212a1eae45d, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:12,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 21:01:12,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:12,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1259376c640005de6681c212a1eae45d, disabling compactions & flushes 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9278c379ce7fc3face94ec9c35be6d79, disabling compactions & flushes 2023-10-05 21:01:12,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:12,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. after waiting 0 ms 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. after waiting 0 ms 2023-10-05 21:01:12,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:12,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:12,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9278c379ce7fc3face94ec9c35be6d79 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 21:01:12,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1259376c640005de6681c212a1eae45d 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 21:01:12,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/.tmp/cf/84affaa7331c4460b382d3376ec2c565 2023-10-05 21:01:12,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/.tmp/cf/98448c42f6d7465f9cb46da8ac4db5cc 2023-10-05 21:01:12,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/.tmp/cf/98448c42f6d7465f9cb46da8ac4db5cc as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf/98448c42f6d7465f9cb46da8ac4db5cc 2023-10-05 21:01:12,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/.tmp/cf/84affaa7331c4460b382d3376ec2c565 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf/84affaa7331c4460b382d3376ec2c565 2023-10-05 21:01:12,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf/98448c42f6d7465f9cb46da8ac4db5cc, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 21:01:12,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf/84affaa7331c4460b382d3376ec2c565, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 21:01:12,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1259376c640005de6681c212a1eae45d in 21ms, sequenceid=5, compaction requested=false 2023-10-05 21:01:12,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 21:01:12,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9278c379ce7fc3face94ec9c35be6d79 in 21ms, sequenceid=5, compaction requested=false 2023-10-05 21:01:12,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 21:01:12,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 21:01:12,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 21:01:12,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:12,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79. 2023-10-05 21:01:12,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9278c379ce7fc3face94ec9c35be6d79: 2023-10-05 21:01:12,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:12,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d. 2023-10-05 21:01:12,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1259376c640005de6681c212a1eae45d: 2023-10-05 21:01:12,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:12,373 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9278c379ce7fc3face94ec9c35be6d79, regionState=CLOSED 2023-10-05 21:01:12,373 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539672373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539672373"}]},"ts":"1696539672373"} 2023-10-05 21:01:12,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1259376c640005de6681c212a1eae45d 2023-10-05 21:01:12,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1259376c640005de6681c212a1eae45d, regionState=CLOSED 2023-10-05 21:01:12,374 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696539672373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539672373"}]},"ts":"1696539672373"} 2023-10-05 21:01:12,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-05 21:01:12,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 9278c379ce7fc3face94ec9c35be6d79, server=jenkins-hbase4.apache.org,34111,1696539600754 in 189 msec 2023-10-05 21:01:12,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-05 21:01:12,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 1259376c640005de6681c212a1eae45d, server=jenkins-hbase4.apache.org,35295,1696539600793 in 188 msec 2023-10-05 21:01:12,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9278c379ce7fc3face94ec9c35be6d79, UNASSIGN in 196 msec 2023-10-05 21:01:12,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-05 21:01:12,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1259376c640005de6681c212a1eae45d, UNASSIGN in 201 msec 2023-10-05 21:01:12,418 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-05 21:01:12,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671509.1259376c640005de6681c212a1eae45d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:12,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696539671509.9278c379ce7fc3face94ec9c35be6d79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:12,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:12,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 21:01:12,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, ASSIGN}] 2023-10-05 21:01:12,468 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, ASSIGN 2023-10-05 21:01:12,469 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:01:12,619 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 21:01:12,621 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e288f2a8a1ae872227f9803ee6f46f1c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:12,621 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696539672621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539672621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539672621"}]},"ts":"1696539672621"} 2023-10-05 21:01:12,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e288f2a8a1ae872227f9803ee6f46f1c, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:12,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 21:01:12,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e288f2a8a1ae872227f9803ee6f46f1c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.', STARTKEY => '', ENDKEY => ''} 2023-10-05 21:01:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. service=AccessControlService 2023-10-05 21:01:12,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/.regioninfo 2023-10-05 21:01:12,787 INFO [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,788 DEBUG [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf 2023-10-05 21:01:12,788 DEBUG [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf 2023-10-05 21:01:12,789 INFO [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e288f2a8a1ae872227f9803ee6f46f1c columnFamilyName cf 2023-10-05 21:01:12,814 DEBUG [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] regionserver.HStore(539): loaded hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/84affaa7331c4460b382d3376ec2c565.9278c379ce7fc3face94ec9c35be6d79->hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf/84affaa7331c4460b382d3376ec2c565-top 2023-10-05 21:01:12,818 DEBUG [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] regionserver.HStore(539): loaded hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/98448c42f6d7465f9cb46da8ac4db5cc.1259376c640005de6681c212a1eae45d->hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf/98448c42f6d7465f9cb46da8ac4db5cc-top 2023-10-05 21:01:12,819 INFO [StoreOpener-e288f2a8a1ae872227f9803ee6f46f1c-1] regionserver.HStore(310): Store=e288f2a8a1ae872227f9803ee6f46f1c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:12,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:12,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e288f2a8a1ae872227f9803ee6f46f1c; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72808897, jitterRate=0.08493711054325104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:12,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e288f2a8a1ae872227f9803ee6f46f1c: 2023-10-05 21:01:12,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c., pid=77, masterSystemTime=1696539672774 2023-10-05 21:01:12,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.,because compaction is disabled. 2023-10-05 21:01:12,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:12,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:12,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e288f2a8a1ae872227f9803ee6f46f1c, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:12,828 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696539672827"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539672827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539672827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539672827"}]},"ts":"1696539672827"} 2023-10-05 21:01:12,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-05 21:01:12,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e288f2a8a1ae872227f9803ee6f46f1c, server=jenkins-hbase4.apache.org,35295,1696539600793 in 206 msec 2023-10-05 21:01:12,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-05 21:01:12,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, ASSIGN in 364 msec 2023-10-05 21:01:12,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1259376c640005de6681c212a1eae45d, 9278c379ce7fc3face94ec9c35be6d79], force=true in 688 msec 2023-10-05 21:01:13,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 21:01:13,262 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-05 21:01:13,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 21:01:13,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539673262 (current time:1696539673262). 2023-10-05 21:01:13,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:13,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x1885aec2 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f04f0ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:13,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:13,274 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:13,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1885aec2 to 127.0.0.1:54534 2023-10-05 21:01:13,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:13,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x25481361 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:13,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@108e4ab4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:13,285 DEBUG [hconnection-0x58c54bd9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:13,286 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:13,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25481361 to 127.0.0.1:54534 2023-10-05 21:01:13,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:13,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 21:01:13,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:13,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 21:01:13,294 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:13,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 21:01:13,296 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 21:01:13,297 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696540273297 2023-10-05 21:01:13,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 21:01:13,300 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:13,300 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:13,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 21:01:13,301 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 21:01:13,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-05 21:01:13,303 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 21:01:13,303 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696540273303 2023-10-05 21:01:13,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,311 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 21:01:13,311 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:13,312 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-05 21:01:13,312 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-05 21:01:13,313 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,313 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,315 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:13,315 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:13,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:13,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:13,315 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:13,315 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,316 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,316 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,317 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 21:01:13,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,317 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:13,317 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 21:01:13,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,318 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:13,318 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 21:01:13,319 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 21:01:13,319 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 21:01:13,320 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 21:01:13,319 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 21:01:13,320 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 21:01:13,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 21:01:13,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,320 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 21:01:13,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,320 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 21:01:13,320 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:13,321 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 21:01:13,321 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 21:01:13,321 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 21:01:13,324 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,324 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:13,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:13,324 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:13,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:13,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:13,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-05 21:01:13,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f508317[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:13,331 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-05 21:01:13,331 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 21:01:13,334 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,334 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:13,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 21:01:13,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:13,334 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 21:01:13,335 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:13,335 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:13,335 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:13,335 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. started... 2023-10-05 21:01:13,336 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e288f2a8a1ae872227f9803ee6f46f1c: 2023-10-05 21:01:13,336 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,336 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:13,336 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/84affaa7331c4460b382d3376ec2c565.9278c379ce7fc3face94ec9c35be6d79->hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf/84affaa7331c4460b382d3376ec2c565-top, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/98448c42f6d7465f9cb46da8ac4db5cc.1259376c640005de6681c212a1eae45d->hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf/98448c42f6d7465f9cb46da8ac4db5cc-top] hfiles 2023-10-05 21:01:13,336 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/84affaa7331c4460b382d3376ec2c565.9278c379ce7fc3face94ec9c35be6d79 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,336 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 21:01:13,337 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:13,337 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 21:01:13,338 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 21:01:13,338 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:13,338 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 21:01:13,341 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/98448c42f6d7465f9cb46da8ac4db5cc.1259376c640005de6681c212a1eae45d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,348 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. completed. 2023-10-05 21:01:13,348 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:13,348 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:13,348 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:13,348 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,348 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 21:01:13,348 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:13,354 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 21:01:13,354 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,354 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:13,354 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 21:01:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:01:13,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-05 21:01:13,357 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-05 21:01:13,357 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:13,357 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:13,357 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,357 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:13,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:13,359 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:13,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,359 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:13,360 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:13,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:13,360 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:13,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:13,363 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,363 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,363 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:13,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:13,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:13,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:13,366 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:13,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:13,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:13,366 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:13,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:13,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:13,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:13,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:13,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:13,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-05 21:01:13,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,388 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696539673297Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696539673367 (+70 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696539673367Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696539673370 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696539673380 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696539673388 (+8 ms) 2023-10-05 21:01:13,391 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 21:01:13,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 91 msec 2023-10-05 21:01:13,400 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 21:01:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:13,402 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402 2023-10-05 21:01:13,402 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43021, tgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402, rawTgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:01:13,435 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:01:13,435 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1277725201_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,435 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-05 21:01:13,444 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:13,462 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,462 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,462 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,463 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,463 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,463 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,464 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,532 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-8560804536751304987.jar 2023-10-05 21:01:13,533 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,533 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,533 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,534 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,534 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,535 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:13,535 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:01:13,535 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:01:13,536 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:01:13,536 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:01:13,536 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:01:13,537 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:01:13,537 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:01:13,537 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:01:13,538 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:01:13,538 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:01:13,539 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:13,539 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:13,539 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:13,540 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:13,540 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:13,540 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:13,540 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:13,871 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:01:13,873 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-05 21:01:13,875 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-05 21:01:13,992 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:01:13,993 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:01:13,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0004_000001 (auth:SIMPLE) 2023-10-05 21:01:14,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0005_000001 (auth:SIMPLE) 2023-10-05 21:01:14,927 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:01:18,415 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0005_000001 (auth:SIMPLE) 2023-10-05 21:01:20,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0005_000001 (auth:SIMPLE) 2023-10-05 21:01:22,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0005_000001 (auth:SIMPLE) 2023-10-05 21:01:24,031 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:01:24,034 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:01:24,042 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,042 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:01:24,043 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:01:24,043 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,043 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 21:01:24,043 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 21:01:24,043 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,044 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 21:01:24,044 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539673402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 21:01:24,050 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 21:01:24,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539684054"}]},"ts":"1696539684054"} 2023-10-05 21:01:24,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-05 21:01:24,057 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-05 21:01:24,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, UNASSIGN}] 2023-10-05 21:01:24,059 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, UNASSIGN 2023-10-05 21:01:24,060 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e288f2a8a1ae872227f9803ee6f46f1c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:24,060 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696539684059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539684059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539684059"}]},"ts":"1696539684059"} 2023-10-05 21:01:24,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e288f2a8a1ae872227f9803ee6f46f1c, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:24,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 21:01:24,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:24,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e288f2a8a1ae872227f9803ee6f46f1c, disabling compactions & flushes 2023-10-05 21:01:24,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:24,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:24,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. after waiting 0 ms 2023-10-05 21:01:24,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:24,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-05 21:01:24,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:24,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c. 2023-10-05 21:01:24,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e288f2a8a1ae872227f9803ee6f46f1c: 2023-10-05 21:01:24,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:24,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e288f2a8a1ae872227f9803ee6f46f1c, regionState=CLOSED 2023-10-05 21:01:24,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696539684227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539684227"}]},"ts":"1696539684227"} 2023-10-05 21:01:24,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-05 21:01:24,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e288f2a8a1ae872227f9803ee6f46f1c, server=jenkins-hbase4.apache.org,35295,1696539600793 in 167 msec 2023-10-05 21:01:24,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-05 21:01:24,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e288f2a8a1ae872227f9803ee6f46f1c, UNASSIGN in 173 msec 2023-10-05 21:01:24,232 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539684232"}]},"ts":"1696539684232"} 2023-10-05 21:01:24,233 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-05 21:01:24,234 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-05 21:01:24,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-10-05 21:01:24,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 21:01:24,356 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-05 21:01:24,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,359 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,360 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,361 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,364 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:24,364 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:24,364 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d 2023-10-05 21:01:24,365 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,365 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,365 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,365 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 21:01:24,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 21:01:24,367 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/recovered.edits] 2023-10-05 21:01:24,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,367 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-05 21:01:24,367 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:01:24,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,367 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-05 21:01:24,367 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:01:24,367 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,367 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/recovered.edits] 2023-10-05 21:01:24,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:24,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 21:01:24,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:24,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:24,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:24,369 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/recovered.edits] 2023-10-05 21:01:24,372 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf/84affaa7331c4460b382d3376ec2c565 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/cf/84affaa7331c4460b382d3376ec2c565 2023-10-05 21:01:24,372 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf/98448c42f6d7465f9cb46da8ac4db5cc to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/cf/98448c42f6d7465f9cb46da8ac4db5cc 2023-10-05 21:01:24,373 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/84affaa7331c4460b382d3376ec2c565.9278c379ce7fc3face94ec9c35be6d79 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/84affaa7331c4460b382d3376ec2c565.9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:24,375 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/98448c42f6d7465f9cb46da8ac4db5cc.1259376c640005de6681c212a1eae45d to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/cf/98448c42f6d7465f9cb46da8ac4db5cc.1259376c640005de6681c212a1eae45d 2023-10-05 21:01:24,375 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/recovered.edits/8.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79/recovered.edits/8.seqid 2023-10-05 21:01:24,375 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9278c379ce7fc3face94ec9c35be6d79 2023-10-05 21:01:24,376 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/recovered.edits/8.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d/recovered.edits/8.seqid 2023-10-05 21:01:24,376 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1259376c640005de6681c212a1eae45d 2023-10-05 21:01:24,377 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/recovered.edits/12.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c/recovered.edits/12.seqid 2023-10-05 21:01:24,378 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e288f2a8a1ae872227f9803ee6f46f1c 2023-10-05 21:01:24,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 21:01:24,380 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,382 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-05 21:01:24,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-05 21:01:24,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-05 21:01:24,385 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539684385"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:24,386 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-05 21:01:24,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e288f2a8a1ae872227f9803ee6f46f1c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696539671510.e288f2a8a1ae872227f9803ee6f46f1c.', STARTKEY => '', ENDKEY => ''}] 2023-10-05 21:01:24,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-05 21:01:24,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539684386"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:24,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-05 21:01:24,389 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-10-05 21:01:24,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 21:01:24,470 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-05 21:01:24,470 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 21:01:24,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539684474"}]},"ts":"1696539684474"} 2023-10-05 21:01:24,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-05 21:01:24,477 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-05 21:01:24,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, UNASSIGN}] 2023-10-05 21:01:24,480 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, UNASSIGN 2023-10-05 21:01:24,480 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, UNASSIGN 2023-10-05 21:01:24,480 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=18ab65e029f773f324bc62d515124c7f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:24,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c0458535c508aa78e87aed3f5e918ec1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:24,481 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539684480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539684480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539684480"}]},"ts":"1696539684480"} 2023-10-05 21:01:24,481 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539684480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539684480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539684480"}]},"ts":"1696539684480"} 2023-10-05 21:01:24,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 18ab65e029f773f324bc62d515124c7f, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:24,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c0458535c508aa78e87aed3f5e918ec1, server=jenkins-hbase4.apache.org,34111,1696539600754}] 2023-10-05 21:01:24,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 21:01:24,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:24,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18ab65e029f773f324bc62d515124c7f, disabling compactions & flushes 2023-10-05 21:01:24,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:24,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:24,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. after waiting 0 ms 2023-10-05 21:01:24,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:24,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:24,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c0458535c508aa78e87aed3f5e918ec1, disabling compactions & flushes 2023-10-05 21:01:24,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:24,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:24,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. after waiting 0 ms 2023-10-05 21:01:24,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:24,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:24,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:24,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:24,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f. 2023-10-05 21:01:24,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18ab65e029f773f324bc62d515124c7f: 2023-10-05 21:01:24,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:24,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1. 2023-10-05 21:01:24,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c0458535c508aa78e87aed3f5e918ec1: 2023-10-05 21:01:24,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:24,654 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c0458535c508aa78e87aed3f5e918ec1, regionState=CLOSED 2023-10-05 21:01:24,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:24,655 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539684654"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539684654"}]},"ts":"1696539684654"} 2023-10-05 21:01:24,655 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=18ab65e029f773f324bc62d515124c7f, regionState=CLOSED 2023-10-05 21:01:24,655 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696539684655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539684655"}]},"ts":"1696539684655"} 2023-10-05 21:01:24,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-05 21:01:24,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c0458535c508aa78e87aed3f5e918ec1, server=jenkins-hbase4.apache.org,34111,1696539600754 in 174 msec 2023-10-05 21:01:24,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-05 21:01:24,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 18ab65e029f773f324bc62d515124c7f, server=jenkins-hbase4.apache.org,37883,1696539600708 in 175 msec 2023-10-05 21:01:24,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c0458535c508aa78e87aed3f5e918ec1, UNASSIGN in 180 msec 2023-10-05 21:01:24,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-05 21:01:24,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=18ab65e029f773f324bc62d515124c7f, UNASSIGN in 180 msec 2023-10-05 21:01:24,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539684660"}]},"ts":"1696539684660"} 2023-10-05 21:01:24,661 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-05 21:01:24,664 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-05 21:01:24,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 194 msec 2023-10-05 21:01:24,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 21:01:24,777 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-05 21:01:24,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,780 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,781 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,782 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,785 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:24,785 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:24,785 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,785 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,785 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,785 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 21:01:24,786 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 21:01:24,786 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,786 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,786 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,786 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,786 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-05 21:01:24,786 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,786 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:24,787 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:01:24,786 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-05 21:01:24,787 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 21:01:24,787 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/recovered.edits] 2023-10-05 21:01:24,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 21:01:24,787 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/recovered.edits] 2023-10-05 21:01:24,791 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf/f74f06a1e01241bdbe13950dcae888c7 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/cf/f74f06a1e01241bdbe13950dcae888c7 2023-10-05 21:01:24,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf/769c6ec2b1dd4c17b36ee35382457512 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/cf/769c6ec2b1dd4c17b36ee35382457512 2023-10-05 21:01:24,794 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f/recovered.edits/9.seqid 2023-10-05 21:01:24,794 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1/recovered.edits/9.seqid 2023-10-05 21:01:24,795 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/18ab65e029f773f324bc62d515124c7f 2023-10-05 21:01:24,795 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c0458535c508aa78e87aed3f5e918ec1 2023-10-05 21:01:24,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 21:01:24,795 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 21:01:24,796 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-05 21:01:24,799 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310051653097c3a0942dfbdbf5b0e4422b09f to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310051653097c3a0942dfbdbf5b0e4422b09f 2023-10-05 21:01:24,800 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005d2ce337b73dd45e1a26e806eb0322598 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005d2ce337b73dd45e1a26e806eb0322598 2023-10-05 21:01:24,800 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 21:01:24,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,804 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-05 21:01:24,806 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-05 21:01:24,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-05 21:01:24,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539684807"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:24,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539684807"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:24,808 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 21:01:24,808 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18ab65e029f773f324bc62d515124c7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696539669649.18ab65e029f773f324bc62d515124c7f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c0458535c508aa78e87aed3f5e918ec1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696539669649.c0458535c508aa78e87aed3f5e918ec1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 21:01:24,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-05 21:01:24,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539684809"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:24,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-05 21:01:24,812 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-10-05 21:01:24,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 21:01:24,889 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-05 21:01:24,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 21:01:24,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 21:01:24,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 21:01:24,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-05 21:01:24,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 21:01:24,930 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:59498 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:58932 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_118692321_1 at /127.0.0.1:33558 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:38979 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_118692321_1 at /127.0.0.1:59484 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:33594 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4069 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 227), ProcessCount=168 (was 168), AvailableMemoryMB=5655 (was 5707) 2023-10-05 21:01:24,930 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-05 21:01:24,950 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=5655 2023-10-05 21:01:24,950 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-05 21:01:24,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 21:01:24,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:24,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:01:24,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-05 21:01:24,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:01:24,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 21:01:24,957 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:24,957 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:24,958 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 empty. 2023-10-05 21:01:24,958 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 empty. 2023-10-05 21:01:24,958 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:24,958 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:24,958 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 21:01:24,967 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 21:01:24,968 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cdc5641fc8f38ad5b35588af962c2676, NAME => 'testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:24,968 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => fa004d0d8c2eb8a6a16edf1e44735910, NAME => 'testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cdc5641fc8f38ad5b35588af962c2676, disabling compactions & flushes 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing fa004d0d8c2eb8a6a16edf1e44735910, disabling compactions & flushes 2023-10-05 21:01:24,976 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:24,976 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. after waiting 0 ms 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. after waiting 0 ms 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:24,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:24,977 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:24,977 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:24,977 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cdc5641fc8f38ad5b35588af962c2676: 2023-10-05 21:01:24,977 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for fa004d0d8c2eb8a6a16edf1e44735910: 2023-10-05 21:01:24,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:01:24,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539684979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539684979"}]},"ts":"1696539684979"} 2023-10-05 21:01:24,980 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539684979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539684979"}]},"ts":"1696539684979"} 2023-10-05 21:01:24,981 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:01:24,982 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:01:24,982 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539684982"}]},"ts":"1696539684982"} 2023-10-05 21:01:24,983 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 21:01:24,986 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:01:24,987 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:01:24,988 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:01:24,988 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:01:24,988 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:01:24,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, ASSIGN}] 2023-10-05 21:01:24,990 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, ASSIGN 2023-10-05 21:01:24,991 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, ASSIGN 2023-10-05 21:01:24,991 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37883,1696539600708; forceNewPlan=false, retain=false 2023-10-05 21:01:24,991 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:01:25,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 21:01:25,141 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:01:25,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fa004d0d8c2eb8a6a16edf1e44735910, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cdc5641fc8f38ad5b35588af962c2676, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539685144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539685144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539685144"}]},"ts":"1696539685144"} 2023-10-05 21:01:25,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539685144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539685144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539685144"}]},"ts":"1696539685144"} 2023-10-05 21:01:25,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure cdc5641fc8f38ad5b35588af962c2676, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:25,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure fa004d0d8c2eb8a6a16edf1e44735910, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 21:01:25,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cdc5641fc8f38ad5b35588af962c2676, NAME => 'testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 21:01:25,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa004d0d8c2eb8a6a16edf1e44735910, NAME => 'testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 21:01:25,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. service=AccessControlService 2023-10-05 21:01:25,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. service=AccessControlService 2023-10-05 21:01:25,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:25,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,303 INFO [StoreOpener-cdc5641fc8f38ad5b35588af962c2676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,303 INFO [StoreOpener-fa004d0d8c2eb8a6a16edf1e44735910-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,304 DEBUG [StoreOpener-cdc5641fc8f38ad5b35588af962c2676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf 2023-10-05 21:01:25,304 DEBUG [StoreOpener-cdc5641fc8f38ad5b35588af962c2676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf 2023-10-05 21:01:25,304 DEBUG [StoreOpener-fa004d0d8c2eb8a6a16edf1e44735910-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf 2023-10-05 21:01:25,304 DEBUG [StoreOpener-fa004d0d8c2eb8a6a16edf1e44735910-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf 2023-10-05 21:01:25,305 INFO [StoreOpener-cdc5641fc8f38ad5b35588af962c2676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cdc5641fc8f38ad5b35588af962c2676 columnFamilyName cf 2023-10-05 21:01:25,305 INFO [StoreOpener-fa004d0d8c2eb8a6a16edf1e44735910-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa004d0d8c2eb8a6a16edf1e44735910 columnFamilyName cf 2023-10-05 21:01:25,306 INFO [StoreOpener-cdc5641fc8f38ad5b35588af962c2676-1] regionserver.HStore(310): Store=cdc5641fc8f38ad5b35588af962c2676/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:25,306 INFO [StoreOpener-fa004d0d8c2eb8a6a16edf1e44735910-1] regionserver.HStore(310): Store=fa004d0d8c2eb8a6a16edf1e44735910/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:25,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:25,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:25,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:25,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cdc5641fc8f38ad5b35588af962c2676; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63904539, jitterRate=-0.04774816334247589}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:25,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cdc5641fc8f38ad5b35588af962c2676: 2023-10-05 21:01:25,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fa004d0d8c2eb8a6a16edf1e44735910; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60027085, jitterRate=-0.10552673041820526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:25,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fa004d0d8c2eb8a6a16edf1e44735910: 2023-10-05 21:01:25,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676., pid=93, masterSystemTime=1696539685297 2023-10-05 21:01:25,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910., pid=94, masterSystemTime=1696539685298 2023-10-05 21:01:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,315 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cdc5641fc8f38ad5b35588af962c2676, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,315 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539685314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539685314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539685314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539685314"}]},"ts":"1696539685314"} 2023-10-05 21:01:25,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,315 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fa004d0d8c2eb8a6a16edf1e44735910, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,315 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539685315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539685315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539685315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539685315"}]},"ts":"1696539685315"} 2023-10-05 21:01:25,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-05 21:01:25,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure cdc5641fc8f38ad5b35588af962c2676, server=jenkins-hbase4.apache.org,35295,1696539600793 in 170 msec 2023-10-05 21:01:25,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-05 21:01:25,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure fa004d0d8c2eb8a6a16edf1e44735910, server=jenkins-hbase4.apache.org,37883,1696539600708 in 170 msec 2023-10-05 21:01:25,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, ASSIGN in 330 msec 2023-10-05 21:01:25,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-05 21:01:25,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, ASSIGN in 330 msec 2023-10-05 21:01:25,320 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:01:25,321 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539685320"}]},"ts":"1696539685320"} 2023-10-05 21:01:25,321 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 21:01:25,324 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:01:25,324 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-05 21:01:25,325 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 21:01:25,328 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:25,329 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:25,328 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:25,328 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:25,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:25,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:25,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:25,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:25,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 378 msec 2023-10-05 21:01:25,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 21:01:25,559 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-05 21:01:25,561 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:25,561 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,563 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:01:25,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:01:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539685574 (current time:1696539685574). 2023-10-05 21:01:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:25,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x28d275a9 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:25,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6620cfd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:25,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:25,587 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:25,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28d275a9 to 127.0.0.1:54534 2023-10-05 21:01:25,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:25,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x34f1cad1 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:25,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fb58edb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:25,595 DEBUG [hconnection-0x6f0bae84-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:25,597 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34f1cad1 to 127.0.0.1:54534 2023-10-05 21:01:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 21:01:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:01:25,605 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:25,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:01:25,609 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:01:25,610 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696540285610 2023-10-05 21:01:25,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:01:25,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:25,611 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:25,611 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:25,612 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:01:25,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 21:01:25,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 21:01:25,616 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 21:01:25,616 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696540285616 2023-10-05 21:01:25,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,624 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-05 21:01:25,624 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,625 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 21:01:25,625 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 21:01:25,625 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,625 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,631 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,631 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,631 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,631 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,632 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,632 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,632 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 21:01:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 21:01:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 21:01:25,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 21:01:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 21:01:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,635 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 21:01:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 21:01:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 21:01:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 21:01:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 21:01:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 21:01:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,637 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,638 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,640 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,640 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,640 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,641 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:25,641 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,641 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3cc117[Count = 1] remaining members to acquire global barrier 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,643 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,643 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 21:01:25,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3cc117[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:25,645 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 21:01:25,645 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,646 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,646 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,646 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,647 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,647 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:01:25,647 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:01:25,647 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:01:25,647 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,647 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:25,647 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 21:01:25,647 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:25,648 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 21:01:25,648 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,648 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 21:01:25,654 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:25,654 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. started... 2023-10-05 21:01:25,654 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:25,654 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. started... 2023-10-05 21:01:25,655 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cdc5641fc8f38ad5b35588af962c2676: 2023-10-05 21:01:25,655 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa004d0d8c2eb8a6a16edf1e44735910: 2023-10-05 21:01:25,655 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,655 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:25,656 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:01:25,656 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,656 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:25,656 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:01:25,667 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. completed. 2023-10-05 21:01:25,667 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:25,667 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. completed. 2023-10-05 21:01:25,667 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 21:01:25,668 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:25,669 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 21:01:25,669 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,669 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,669 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,669 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 21:01:25,669 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 21:01:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,670 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,671 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 21:01:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:01:25,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 21:01:25,677 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 21:01:25,677 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:25,677 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:25,677 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,677 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,681 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,680 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,681 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,682 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,683 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,684 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,684 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,687 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,687 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,686 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,688 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:01:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,688 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 21:01:25,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 21:01:25,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,711 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:25,712 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696539685610Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696539685696 (+86 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696539685696Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696539685696Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696539685699 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696539685706 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696539685711 (+5 ms) 2023-10-05 21:01:25,715 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 21:01:25,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:01:25,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:25,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 104 msec 2023-10-05 21:01:25,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37883] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:01:25,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35295] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:01:25,721 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:25,721 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,721 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:01:25,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:01:25,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539685730 (current time:1696539685730). 2023-10-05 21:01:25,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:25,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x1c2e150e to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:25,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5418e0a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:25,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:25,738 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:25,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c2e150e to 127.0.0.1:54534 2023-10-05 21:01:25,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:25,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x09b3b41d to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:25,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d95640, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:25,747 DEBUG [hconnection-0x76d7a7a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:25,749 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:25,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09b3b41d to 127.0.0.1:54534 2023-10-05 21:01:25,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:25,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 21:01:25,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:25,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:01:25,756 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:25,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:01:25,758 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:01:25,758 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696540285758 2023-10-05 21:01:25,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 21:01:25,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:25,759 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:25,760 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:25,760 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 21:01:25,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 21:01:25,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 21:01:25,762 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 21:01:25,763 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696540285763 2023-10-05 21:01:25,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,770 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-05 21:01:25,770 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,771 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 21:01:25,771 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 21:01:25,772 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,772 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,774 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,774 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,774 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,774 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,774 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,774 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,774 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,775 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,775 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 21:01:25,775 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 21:01:25,776 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,776 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 21:01:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 21:01:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 21:01:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 21:01:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 21:01:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 21:01:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 21:01:25,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 21:01:25,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 21:01:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 21:01:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 21:01:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 21:01:25,783 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,783 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,786 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,786 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:25,786 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,788 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,788 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,788 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,788 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,788 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,788 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 21:01:25,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@243c1a1[Count = 1] remaining members to acquire global barrier 2023-10-05 21:01:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 21:01:25,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@243c1a1[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:25,792 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 21:01:25,792 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:01:25,796 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:25,796 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:25,796 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. started... 2023-10-05 21:01:25,796 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 21:01:25,796 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. started... 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:25,796 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,796 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:25,796 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fa004d0d8c2eb8a6a16edf1e44735910 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-05 21:01:25,797 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cdc5641fc8f38ad5b35588af962c2676 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-05 21:01:25,796 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:25,798 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 21:01:25,798 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,798 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 21:01:25,814 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310050483e83b9c6a4acd848cf9dbbdc9ca76 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310050483e83b9c6a4acd848cf9dbbdc9ca76 2023-10-05 21:01:25,814 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310053bdd9beb26374260b487d85e1bee8574 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310053bdd9beb26374260b487d85e1bee8574 2023-10-05 21:01:25,821 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/.tmp/cf/622a9b8ba4b9409f9f07ab957ef466a1 2023-10-05 21:01:25,822 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/.tmp/cf/97a8b533e9ab4153b655d0509ee64bd9 2023-10-05 21:01:25,826 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/.tmp/cf/622a9b8ba4b9409f9f07ab957ef466a1 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf/622a9b8ba4b9409f9f07ab957ef466a1 2023-10-05 21:01:25,827 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/.tmp/cf/97a8b533e9ab4153b655d0509ee64bd9 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf/97a8b533e9ab4153b655d0509ee64bd9 2023-10-05 21:01:25,831 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf/622a9b8ba4b9409f9f07ab957ef466a1, entries=2, sequenceid=6, filesize=5.2 K 2023-10-05 21:01:25,832 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for fa004d0d8c2eb8a6a16edf1e44735910 in 36ms, sequenceid=6, compaction requested=false 2023-10-05 21:01:25,832 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 21:01:25,832 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa004d0d8c2eb8a6a16edf1e44735910: 2023-10-05 21:01:25,832 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,834 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:25,834 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf/622a9b8ba4b9409f9f07ab957ef466a1] hfiles 2023-10-05 21:01:25,834 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf/622a9b8ba4b9409f9f07ab957ef466a1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,834 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf/97a8b533e9ab4153b655d0509ee64bd9, entries=48, sequenceid=6, filesize=13.2 K 2023-10-05 21:01:25,835 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for cdc5641fc8f38ad5b35588af962c2676 in 39ms, sequenceid=6, compaction requested=false 2023-10-05 21:01:25,836 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cdc5641fc8f38ad5b35588af962c2676: 2023-10-05 21:01:25,836 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,836 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:25,836 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf/97a8b533e9ab4153b655d0509ee64bd9] hfiles 2023-10-05 21:01:25,836 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf/97a8b533e9ab4153b655d0509ee64bd9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,847 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. completed. 2023-10-05 21:01:25,847 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 21:01:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:25,848 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. completed. 2023-10-05 21:01:25,848 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 21:01:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:25,849 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 21:01:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 21:01:25,851 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,851 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 21:01:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,851 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,851 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 21:01:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:01:25,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 21:01:25,858 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 21:01:25,858 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:25,858 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:25,858 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,858 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:25,860 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,860 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,861 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:01:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:25,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:01:25,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,861 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,861 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:01:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,863 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,864 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:25,865 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,865 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,868 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:25,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,867 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:25,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:25,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:25,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:01:25,869 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:25,870 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,870 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310053bdd9beb26374260b487d85e1bee8574, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310050483e83b9c6a4acd848cf9dbbdc9ca76] mob files 2023-10-05 21:01:25,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310053bdd9beb26374260b487d85e1bee8574 2023-10-05 21:01:25,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310050483e83b9c6a4acd848cf9dbbdc9ca76 2023-10-05 21:01:25,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 21:01:25,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,894 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:25,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696539685758Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696539685876 (+118 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696539685876Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696539685876Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696539685879 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696539685886 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696539685893 (+7 ms) 2023-10-05 21:01:25,898 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 21:01:25,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 139 msec 2023-10-05 21:01:26,062 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:26,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 21:01:26,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:26,063 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063 2023-10-05 21:01:26,063 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43021, tgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063, rawTgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:01:26,084 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:01:26,084 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-983975828_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:26,084 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-05 21:01:26,089 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:26,108 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,108 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,108 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,108 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,109 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,109 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,109 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-8709697330094962760.jar 2023-10-05 21:01:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:26,178 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:01:26,178 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:01:26,179 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:01:26,179 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:01:26,179 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:01:26,179 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:01:26,180 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:01:26,180 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:01:26,180 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:01:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:01:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:26,183 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:26,519 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:01:26,521 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-05 21:01:29,069 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:01:29,070 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:01:29,072 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0005_000001 (auth:SIMPLE) 2023-10-05 21:01:29,800 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:01:30,004 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0006_000001 (auth:SIMPLE) 2023-10-05 21:01:33,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0006_000001 (auth:SIMPLE) 2023-10-05 21:01:35,855 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:01:35,856 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:01:35,861 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:35,861 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:01:35,862 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:01:35,862 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:35,862 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 21:01:35,862 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 21:01:35,862 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:35,863 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 21:01:35,863 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539686063/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 21:01:35,867 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-05 21:01:35,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-05 21:01:35,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:35,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 21:01:35,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539695871"}]},"ts":"1696539695871"} 2023-10-05 21:01:35,873 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 21:01:35,874 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-05 21:01:35,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, UNASSIGN}] 2023-10-05 21:01:35,877 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, UNASSIGN 2023-10-05 21:01:35,877 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, UNASSIGN 2023-10-05 21:01:35,877 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fa004d0d8c2eb8a6a16edf1e44735910, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:35,877 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cdc5641fc8f38ad5b35588af962c2676, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:35,877 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539695877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539695877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539695877"}]},"ts":"1696539695877"} 2023-10-05 21:01:35,877 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539695877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539695877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539695877"}]},"ts":"1696539695877"} 2023-10-05 21:01:35,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure fa004d0d8c2eb8a6a16edf1e44735910, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:35,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure cdc5641fc8f38ad5b35588af962c2676, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:35,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 21:01:36,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:36,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:36,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cdc5641fc8f38ad5b35588af962c2676, disabling compactions & flushes 2023-10-05 21:01:36,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fa004d0d8c2eb8a6a16edf1e44735910, disabling compactions & flushes 2023-10-05 21:01:36,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:36,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:36,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:36,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:36,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. after waiting 0 ms 2023-10-05 21:01:36,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. after waiting 0 ms 2023-10-05 21:01:36,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:36,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:36,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:36,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:36,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:36,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:36,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910. 2023-10-05 21:01:36,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676. 2023-10-05 21:01:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fa004d0d8c2eb8a6a16edf1e44735910: 2023-10-05 21:01:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cdc5641fc8f38ad5b35588af962c2676: 2023-10-05 21:01:36,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:36,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fa004d0d8c2eb8a6a16edf1e44735910, regionState=CLOSED 2023-10-05 21:01:36,042 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539696042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539696042"}]},"ts":"1696539696042"} 2023-10-05 21:01:36,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:36,043 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cdc5641fc8f38ad5b35588af962c2676, regionState=CLOSED 2023-10-05 21:01:36,043 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696539696043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539696043"}]},"ts":"1696539696043"} 2023-10-05 21:01:36,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-05 21:01:36,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure fa004d0d8c2eb8a6a16edf1e44735910, server=jenkins-hbase4.apache.org,37883,1696539600708 in 166 msec 2023-10-05 21:01:36,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-05 21:01:36,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure cdc5641fc8f38ad5b35588af962c2676, server=jenkins-hbase4.apache.org,35295,1696539600793 in 165 msec 2023-10-05 21:01:36,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa004d0d8c2eb8a6a16edf1e44735910, UNASSIGN in 170 msec 2023-10-05 21:01:36,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-05 21:01:36,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cdc5641fc8f38ad5b35588af962c2676, UNASSIGN in 171 msec 2023-10-05 21:01:36,048 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539696048"}]},"ts":"1696539696048"} 2023-10-05 21:01:36,049 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 21:01:36,050 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-05 21:01:36,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 183 msec 2023-10-05 21:01:36,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 21:01:36,174 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-05 21:01:36,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,178 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,178 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,180 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,182 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:36,182 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:36,183 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,183 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,183 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,183 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 21:01:36,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 21:01:36,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 21:01:36,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 21:01:36,185 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/recovered.edits] 2023-10-05 21:01:36,185 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/recovered.edits] 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,185 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 21:01:36,188 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf/622a9b8ba4b9409f9f07ab957ef466a1 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/cf/622a9b8ba4b9409f9f07ab957ef466a1 2023-10-05 21:01:36,189 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf/97a8b533e9ab4153b655d0509ee64bd9 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/cf/97a8b533e9ab4153b655d0509ee64bd9 2023-10-05 21:01:36,191 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910/recovered.edits/9.seqid 2023-10-05 21:01:36,191 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676/recovered.edits/9.seqid 2023-10-05 21:01:36,192 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa004d0d8c2eb8a6a16edf1e44735910 2023-10-05 21:01:36,192 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cdc5641fc8f38ad5b35588af962c2676 2023-10-05 21:01:36,192 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 21:01:36,192 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 21:01:36,193 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-05 21:01:36,196 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310053bdd9beb26374260b487d85e1bee8574 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310053bdd9beb26374260b487d85e1bee8574 2023-10-05 21:01:36,197 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310050483e83b9c6a4acd848cf9dbbdc9ca76 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310050483e83b9c6a4acd848cf9dbbdc9ca76 2023-10-05 21:01:36,198 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 21:01:36,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,201 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-05 21:01:36,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-05 21:01:36,204 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,204 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-05 21:01:36,204 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539696204"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:36,204 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539696204"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:36,206 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 21:01:36,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fa004d0d8c2eb8a6a16edf1e44735910, NAME => 'testtb-testEmptyExportFileSystemState,,1696539684951.fa004d0d8c2eb8a6a16edf1e44735910.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cdc5641fc8f38ad5b35588af962c2676, NAME => 'testtb-testEmptyExportFileSystemState,1,1696539684951.cdc5641fc8f38ad5b35588af962c2676.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 21:01:36,206 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-05 21:01:36,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539696206"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:36,208 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-05 21:01:36,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 21:01:36,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-10-05 21:01:36,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 21:01:36,287 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-05 21:01:36,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-05 21:01:36,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:36,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-05 21:01:36,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-05 21:01:36,323 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 763) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1451110742_1 at /127.0.0.1:34126 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:41847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1451110742_1 at /127.0.0.1:52142 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:54682 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:34691 from appattempt_1696539607178_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_223626953_17 at /127.0.0.1:35980 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x75c75c1c-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-983975828_17 at /127.0.0.1:44392 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:37785 from appattempt_1696539607178_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=927 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 202), ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=5624 (was 5655) 2023-10-05 21:01:36,323 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 21:01:36,342 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=171, AvailableMemoryMB=5624 2023-10-05 21:01:36,342 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 21:01:36,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 21:01:36,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:36,346 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 21:01:36,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-05 21:01:36,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 21:01:36,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 21:01:36,349 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,349 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,350 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca empty. 2023-10-05 21:01:36,350 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 empty. 2023-10-05 21:01:36,350 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,350 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,350 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 21:01:36,359 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-05 21:01:36,361 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2a36ffdf61175d997b5aec29b99fece4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:36,361 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a93388af15b7f9f9c4e0986ad31aaca, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 0a93388af15b7f9f9c4e0986ad31aaca, disabling compactions & flushes 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:36,375 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 2a36ffdf61175d997b5aec29b99fece4, disabling compactions & flushes 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,375 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. after waiting 0 ms 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. after waiting 0 ms 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,375 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,375 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 2a36ffdf61175d997b5aec29b99fece4: 2023-10-05 21:01:36,375 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 0a93388af15b7f9f9c4e0986ad31aaca: 2023-10-05 21:01:36,377 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 21:01:36,378 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539696378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539696378"}]},"ts":"1696539696378"} 2023-10-05 21:01:36,378 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539696378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539696378"}]},"ts":"1696539696378"} 2023-10-05 21:01:36,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 21:01:36,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 21:01:36,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539696381"}]},"ts":"1696539696381"} 2023-10-05 21:01:36,382 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-05 21:01:36,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 21:01:36,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 21:01:36,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 21:01:36,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 21:01:36,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 21:01:36,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, ASSIGN}] 2023-10-05 21:01:36,390 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, ASSIGN 2023-10-05 21:01:36,390 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, ASSIGN 2023-10-05 21:01:36,390 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35295,1696539600793; forceNewPlan=false, retain=false 2023-10-05 21:01:36,390 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37883,1696539600708; forceNewPlan=false, retain=false 2023-10-05 21:01:36,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 21:01:36,541 INFO [jenkins-hbase4:33411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 21:01:36,543 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0a93388af15b7f9f9c4e0986ad31aaca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:36,543 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2a36ffdf61175d997b5aec29b99fece4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:36,544 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539696543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539696543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539696543"}]},"ts":"1696539696543"} 2023-10-05 21:01:36,544 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539696543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539696543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539696543"}]},"ts":"1696539696543"} 2023-10-05 21:01:36,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 0a93388af15b7f9f9c4e0986ad31aaca, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:36,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 2a36ffdf61175d997b5aec29b99fece4, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:36,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 21:01:36,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a93388af15b7f9f9c4e0986ad31aaca, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 21:01:36,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a36ffdf61175d997b5aec29b99fece4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 21:01:36,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. service=AccessControlService 2023-10-05 21:01:36,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. service=AccessControlService 2023-10-05 21:01:36,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:36,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 21:01:36,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:36,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 21:01:36,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,702 INFO [StoreOpener-0a93388af15b7f9f9c4e0986ad31aaca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,702 INFO [StoreOpener-2a36ffdf61175d997b5aec29b99fece4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,704 DEBUG [StoreOpener-0a93388af15b7f9f9c4e0986ad31aaca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf 2023-10-05 21:01:36,704 DEBUG [StoreOpener-2a36ffdf61175d997b5aec29b99fece4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf 2023-10-05 21:01:36,704 DEBUG [StoreOpener-2a36ffdf61175d997b5aec29b99fece4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf 2023-10-05 21:01:36,704 DEBUG [StoreOpener-0a93388af15b7f9f9c4e0986ad31aaca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf 2023-10-05 21:01:36,704 INFO [StoreOpener-2a36ffdf61175d997b5aec29b99fece4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a36ffdf61175d997b5aec29b99fece4 columnFamilyName cf 2023-10-05 21:01:36,704 INFO [StoreOpener-0a93388af15b7f9f9c4e0986ad31aaca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a93388af15b7f9f9c4e0986ad31aaca columnFamilyName cf 2023-10-05 21:01:36,705 INFO [StoreOpener-0a93388af15b7f9f9c4e0986ad31aaca-1] regionserver.HStore(310): Store=0a93388af15b7f9f9c4e0986ad31aaca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:36,705 INFO [StoreOpener-2a36ffdf61175d997b5aec29b99fece4-1] regionserver.HStore(310): Store=2a36ffdf61175d997b5aec29b99fece4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 21:01:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:36,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:36,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:36,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 21:01:36,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a93388af15b7f9f9c4e0986ad31aaca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59319841, jitterRate=-0.11606548726558685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:36,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a93388af15b7f9f9c4e0986ad31aaca: 2023-10-05 21:01:36,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a36ffdf61175d997b5aec29b99fece4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58855813, jitterRate=-0.1229800432920456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 21:01:36,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a36ffdf61175d997b5aec29b99fece4: 2023-10-05 21:01:36,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca., pid=108, masterSystemTime=1696539696697 2023-10-05 21:01:36,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4., pid=109, masterSystemTime=1696539696697 2023-10-05 21:01:36,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,715 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0a93388af15b7f9f9c4e0986ad31aaca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:36,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:36,715 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539696714"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539696714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539696714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539696714"}]},"ts":"1696539696714"} 2023-10-05 21:01:36,715 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2a36ffdf61175d997b5aec29b99fece4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:36,715 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539696715"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696539696715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696539696715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696539696715"}]},"ts":"1696539696715"} 2023-10-05 21:01:36,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-05 21:01:36,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 0a93388af15b7f9f9c4e0986ad31aaca, server=jenkins-hbase4.apache.org,37883,1696539600708 in 171 msec 2023-10-05 21:01:36,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-05 21:01:36,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, ASSIGN in 331 msec 2023-10-05 21:01:36,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 2a36ffdf61175d997b5aec29b99fece4, server=jenkins-hbase4.apache.org,35295,1696539600793 in 171 msec 2023-10-05 21:01:36,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-05 21:01:36,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, ASSIGN in 332 msec 2023-10-05 21:01:36,721 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 21:01:36,721 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539696721"}]},"ts":"1696539696721"} 2023-10-05 21:01:36,722 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-05 21:01:36,724 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 21:01:36,724 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-05 21:01:36,726 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 21:01:36,727 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,727 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,727 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,727 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:36,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:36,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:36,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:36,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 21:01:36,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 384 msec 2023-10-05 21:01:36,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 21:01:36,951 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-05 21:01:36,953 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:36,953 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:36,954 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:01:36,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 21:01:36,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539696965 (current time:1696539696965). 2023-10-05 21:01:36,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:36,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x7b5e6c96 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:36,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b2d9369, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:36,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:36,977 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b5e6c96 to 127.0.0.1:54534 2023-10-05 21:01:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:36,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x754b8f2d to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7df967ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:36,985 DEBUG [hconnection-0x5a6815c3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:36,986 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:36,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x754b8f2d to 127.0.0.1:54534 2023-10-05 21:01:36,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:36,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 21:01:36,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:36,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 21:01:36,993 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:36,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 21:01:36,995 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 21:01:36,996 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696540296996 2023-10-05 21:01:36,996 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:36,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 21:01:36,997 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:36,997 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:36,998 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 21:01:36,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 21:01:36,999 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-05 21:01:36,999 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 21:01:37,000 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696540297000 2023-10-05 21:01:37,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,008 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 21:01:37,008 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,010 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 21:01:37,010 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 21:01:37,010 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,010 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,017 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,017 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,017 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,017 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,018 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,018 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,018 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,018 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,019 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 21:01:37,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,019 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 21:01:37,019 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 21:01:37,019 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,019 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,019 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,021 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 21:01:37,022 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 21:01:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 21:01:37,030 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,030 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,031 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 21:01:37,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b88d9a[Count = 1] remaining members to acquire global barrier 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 21:01:37,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b88d9a[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:37,034 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 21:01:37,034 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 21:01:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:37,036 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:37,036 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. started... 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:37,036 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,036 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:37,036 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a93388af15b7f9f9c4e0986ad31aaca: 2023-10-05 21:01:37,036 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:37,037 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. started... 2023-10-05 21:01:37,037 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,038 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a36ffdf61175d997b5aec29b99fece4: 2023-10-05 21:01:37,038 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:37,038 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:01:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 21:01:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,038 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 21:01:37,039 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:37,039 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 21:01:37,060 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. completed. 2023-10-05 21:01:37,061 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 21:01:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 21:01:37,064 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 21:01:37,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:01:37,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 21:01:37,070 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. completed. 2023-10-05 21:01:37,070 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:37,070 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:37,070 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:37,070 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,070 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 21:01:37,070 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:37,073 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 21:01:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 21:01:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 21:01:37,078 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 21:01:37,078 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:37,078 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:37,078 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,078 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:37,081 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,082 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,082 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,082 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,083 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,083 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,084 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,085 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,085 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,086 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,089 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,089 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:01:37,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,091 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,092 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,092 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 21:01:37,097 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:37,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 21:01:37,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:01:37,099 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:01:37,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 21:01:37,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,121 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696539696996Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696539697098 (+102 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696539697098Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696539697098Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696539697102 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696539697115 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696539697120 (+5 ms) 2023-10-05 21:01:37,123 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 21:01:37,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 127 msec 2023-10-05 21:01:37,299 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:37,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 21:01:37,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:37,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:01:37,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35295] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 21:01:37,305 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,305 DEBUG [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:37,306 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 21:01:37,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 21:01:37,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696539697314 (current time:1696539697314). 2023-10-05 21:01:37,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 21:01:37,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x66b3ffdb to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:37,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@273d55ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:37,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:37,327 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:37,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66b3ffdb to 127.0.0.1:54534 2023-10-05 21:01:37,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:37,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(139): Connect 0x5b89c019 to 127.0.0.1:54534 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 21:01:37,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@223db194, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 21:01:37,335 DEBUG [hconnection-0x6fe2120a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 21:01:37,337 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 21:01:37,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b89c019 to 127.0.0.1:54534 2023-10-05 21:01:37,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:01:37,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 21:01:37,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 21:01:37,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 21:01:37,344 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot, current working dir path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 21:01:37,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 21:01:37,346 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 21:01:37,347 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696540297347 2023-10-05 21:01:37,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 21:01:37,348 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 21:01:37,348 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 21:01:37,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 21:01:37,349 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 21:01:37,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 21:01:37,351 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 21:01:37,351 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696540297351 2023-10-05 21:01:37,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,360 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 21:01:37,360 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,361 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 21:01:37,361 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 21:01:37,361 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,362 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,364 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,364 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,364 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,364 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,364 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,364 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,364 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,365 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 21:01:37,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,366 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 21:01:37,366 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 21:01:37,366 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,366 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 21:01:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 21:01:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 21:01:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 21:01:37,368 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34111,1696539600754' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 21:01:37,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,370 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,370 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,370 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,371 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 21:01:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35295,1696539600793' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6bfe61[Count = 1] remaining members to acquire global barrier 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37883,1696539600708' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 21:01:37,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6bfe61[Count = 0] remaining members to acquire global barrier 2023-10-05 21:01:37,374 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 21:01:37,374 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 21:01:37,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,381 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,381 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 21:01:37,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:37,382 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 21:01:37,382 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:37,382 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. started... 2023-10-05 21:01:37,382 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,382 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 21:01:37,382 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a36ffdf61175d997b5aec29b99fece4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 21:01:37,382 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. started... 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 21:01:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34111,1696539600754' in zk 2023-10-05 21:01:37,382 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a93388af15b7f9f9c4e0986ad31aaca 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 21:01:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 21:01:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,34111,1696539600754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 21:01:37,399 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005fe3a07b8bae841b4a0f2831bddd474b6 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005fe3a07b8bae841b4a0f2831bddd474b6 2023-10-05 21:01:37,399 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310053a1381ebe40f4552bb391cb51f3e2811 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310053a1381ebe40f4552bb391cb51f3e2811 2023-10-05 21:01:37,405 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/.tmp/cf/481f591eecaf4f92805b96a479d145b7 2023-10-05 21:01:37,406 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/.tmp/cf/352e4a32c0eb406eae666287ceef5c2e 2023-10-05 21:01:37,410 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/.tmp/cf/481f591eecaf4f92805b96a479d145b7 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf/481f591eecaf4f92805b96a479d145b7 2023-10-05 21:01:37,410 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/.tmp/cf/352e4a32c0eb406eae666287ceef5c2e as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf/352e4a32c0eb406eae666287ceef5c2e 2023-10-05 21:01:37,414 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf/481f591eecaf4f92805b96a479d145b7, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 21:01:37,415 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf/352e4a32c0eb406eae666287ceef5c2e, entries=46, sequenceid=6, filesize=13.2 K 2023-10-05 21:01:37,415 INFO [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0a93388af15b7f9f9c4e0986ad31aaca in 33ms, sequenceid=6, compaction requested=false 2023-10-05 21:01:37,415 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 21:01:37,415 INFO [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2a36ffdf61175d997b5aec29b99fece4 in 33ms, sequenceid=6, compaction requested=false 2023-10-05 21:01:37,415 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a93388af15b7f9f9c4e0986ad31aaca: 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a36ffdf61175d997b5aec29b99fece4: 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf/481f591eecaf4f92805b96a479d145b7] hfiles 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf/481f591eecaf4f92805b96a479d145b7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,418 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf/352e4a32c0eb406eae666287ceef5c2e] hfiles 2023-10-05 21:01:37,419 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf/352e4a32c0eb406eae666287ceef5c2e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,425 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. completed. 2023-10-05 21:01:37,425 DEBUG [rs(jenkins-hbase4.apache.org,37883,1696539600708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:37,425 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:37,425 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:37,425 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,425 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 21:01:37,425 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37883,1696539600708' in zk 2023-10-05 21:01:37,425 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. completed. 2023-10-05 21:01:37,425 DEBUG [rs(jenkins-hbase4.apache.org,35295,1696539600793)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 21:01:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 21:01:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 21:01:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35295,1696539600793' in zk 2023-10-05 21:01:37,427 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,427 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 21:01:37,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,427 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,427 DEBUG [member: 'jenkins-hbase4.apache.org,37883,1696539600708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 21:01:37,428 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 21:01:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,35295,1696539600793' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 21:01:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37883,1696539600708': 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37883,1696539600708' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35295,1696539600793': 2023-10-05 21:01:37,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35295,1696539600793' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 21:01:37,436 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 21:01:37,436 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 21:01:37,436 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 21:01:37,436 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,436 INFO [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 21:01:37,439 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,439 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,440 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,440 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 21:01:37,442 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,442 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,442 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:01:37,445 DEBUG [(jenkins-hbase4.apache.org,33411,1696539599455)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,446 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 21:01:37,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 21:01:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 21:01:37,445 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 21:01:37,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,446 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,447 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:37,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 21:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 21:01:37,447 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,447 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310053a1381ebe40f4552bb391cb51f3e2811, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005fe3a07b8bae841b4a0f2831bddd474b6] mob files 2023-10-05 21:01:37,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310053a1381ebe40f4552bb391cb51f3e2811 2023-10-05 21:01:37,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005fe3a07b8bae841b4a0f2831bddd474b6 2023-10-05 21:01:37,448 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:37,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 21:01:37,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 21:01:37,449 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 21:01:37,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 21:01:37,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,469 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696539697347Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696539697453 (+106 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696539697453Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696539697453Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696539697456 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696539697462 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696539697469 (+7 ms) 2023-10-05 21:01:37,472 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 21:01:37,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 124 msec 2023-10-05 21:01:37,649 DEBUG [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 21:01:37,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 21:01:37,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 21:01:37,651 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651 2023-10-05 21:01:37,651 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43021, tgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651, rawTgtDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651, srcFsUri=hdfs://localhost:43021, srcDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:01:37,672 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d 2023-10-05 21:01:37,672 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1034381949_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,672 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43021, inputRoot=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d, snapshotDir=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-05 21:01:37,684 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:37,699 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,700 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,700 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,700 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,701 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,701 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,701 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,768 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/hadoop-4461806116932785529.jar 2023-10-05 21:01:37,768 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,768 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,769 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,769 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,769 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,770 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 21:01:37,770 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 21:01:37,770 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 21:01:37,771 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 21:01:37,771 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 21:01:37,771 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 21:01:37,772 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 21:01:37,772 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 21:01:37,772 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 21:01:37,772 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 21:01:37,773 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 21:01:37,773 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:37,774 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:37,774 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:37,774 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:37,774 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 21:01:37,775 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:37,775 DEBUG [Listener at jenkins-hbase4.apache.org/40083] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 21:01:38,108 WARN [Listener at jenkins-hbase4.apache.org/40083] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 21:01:38,110 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-05 21:01:38,112 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-05 21:01:40,933 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:01:40,933 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 21:01:40,940 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0006_000001 (auth:SIMPLE) 2023-10-05 21:01:41,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0007_000001 (auth:SIMPLE) 2023-10-05 21:01:41,624 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:01:44,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0007_000001 (auth:SIMPLE) 2023-10-05 21:01:46,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0007_000001 (auth:SIMPLE) 2023-10-05 21:01:49,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696539607178_0007_000001 (auth:SIMPLE) 2023-10-05 21:01:51,274 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 21:01:51,275 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 21:01:51,285 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,285 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 21:01:51,286 INFO [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 21:01:51,286 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,286 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 21:01:51,286 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 21:01:51,286 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_223626953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,287 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 21:01:51,287 DEBUG [Listener at jenkins-hbase4.apache.org/40083] snapshot.TestExportSnapshot(367): hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/export-test/export-1696539697651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 21:01:51,292 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 21:01:51,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539711296"}]},"ts":"1696539711296"} 2023-10-05 21:01:51,297 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-05 21:01:51,299 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-05 21:01:51,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, UNASSIGN}] 2023-10-05 21:01:51,301 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, UNASSIGN 2023-10-05 21:01:51,301 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, UNASSIGN 2023-10-05 21:01:51,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0a93388af15b7f9f9c4e0986ad31aaca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:01:51,302 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2a36ffdf61175d997b5aec29b99fece4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:01:51,302 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539711302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539711302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539711302"}]},"ts":"1696539711302"} 2023-10-05 21:01:51,302 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539711302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696539711302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696539711302"}]},"ts":"1696539711302"} 2023-10-05 21:01:51,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 0a93388af15b7f9f9c4e0986ad31aaca, server=jenkins-hbase4.apache.org,37883,1696539600708}] 2023-10-05 21:01:51,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 2a36ffdf61175d997b5aec29b99fece4, server=jenkins-hbase4.apache.org,35295,1696539600793}] 2023-10-05 21:01:51,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 21:01:51,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:51,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a93388af15b7f9f9c4e0986ad31aaca, disabling compactions & flushes 2023-10-05 21:01:51,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:51,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:51,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. after waiting 0 ms 2023-10-05 21:01:51,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:51,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a36ffdf61175d997b5aec29b99fece4, disabling compactions & flushes 2023-10-05 21:01:51,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. after waiting 0 ms 2023-10-05 21:01:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:51,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:51,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:01:51,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:51,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca. 2023-10-05 21:01:51,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a93388af15b7f9f9c4e0986ad31aaca: 2023-10-05 21:01:51,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:01:51,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4. 2023-10-05 21:01:51,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a36ffdf61175d997b5aec29b99fece4: 2023-10-05 21:01:51,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:51,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0a93388af15b7f9f9c4e0986ad31aaca, regionState=CLOSED 2023-10-05 21:01:51,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539711471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539711471"}]},"ts":"1696539711471"} 2023-10-05 21:01:51,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:51,471 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2a36ffdf61175d997b5aec29b99fece4, regionState=CLOSED 2023-10-05 21:01:51,472 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696539711471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696539711471"}]},"ts":"1696539711471"} 2023-10-05 21:01:51,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-05 21:01:51,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 0a93388af15b7f9f9c4e0986ad31aaca, server=jenkins-hbase4.apache.org,37883,1696539600708 in 169 msec 2023-10-05 21:01:51,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a93388af15b7f9f9c4e0986ad31aaca, UNASSIGN in 175 msec 2023-10-05 21:01:51,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-05 21:01:51,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 2a36ffdf61175d997b5aec29b99fece4, server=jenkins-hbase4.apache.org,35295,1696539600793 in 170 msec 2023-10-05 21:01:51,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-05 21:01:51,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2a36ffdf61175d997b5aec29b99fece4, UNASSIGN in 176 msec 2023-10-05 21:01:51,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696539711477"}]},"ts":"1696539711477"} 2023-10-05 21:01:51,478 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-05 21:01:51,480 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-05 21:01:51,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-10-05 21:01:51,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 21:01:51,598 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-05 21:01:51,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,603 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,606 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:51,606 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:51,607 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,607 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,607 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,607 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,607 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 21:01:51,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 21:01:51,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 21:01:51,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 21:01:51,609 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/recovered.edits] 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,609 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf, FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/recovered.edits] 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:51,609 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 21:01:51,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 21:01:51,613 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf/481f591eecaf4f92805b96a479d145b7 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/cf/481f591eecaf4f92805b96a479d145b7 2023-10-05 21:01:51,614 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf/352e4a32c0eb406eae666287ceef5c2e to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/cf/352e4a32c0eb406eae666287ceef5c2e 2023-10-05 21:01:51,616 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca/recovered.edits/9.seqid 2023-10-05 21:01:51,617 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/recovered.edits/9.seqid to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4/recovered.edits/9.seqid 2023-10-05 21:01:51,617 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a93388af15b7f9f9c4e0986ad31aaca 2023-10-05 21:01:51,617 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2a36ffdf61175d997b5aec29b99fece4 2023-10-05 21:01:51,617 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 21:01:51,618 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 21:01:51,618 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-05 21:01:51,621 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310053a1381ebe40f4552bb391cb51f3e2811 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310053a1381ebe40f4552bb391cb51f3e2811 2023-10-05 21:01:51,622 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005fe3a07b8bae841b4a0f2831bddd474b6 to hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005fe3a07b8bae841b4a0f2831bddd474b6 2023-10-05 21:01:51,623 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 21:01:51,625 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,626 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-05 21:01:51,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-05 21:01:51,629 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,629 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-05 21:01:51,629 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539711629"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:51,629 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696539711629"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:51,630 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 21:01:51,630 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a93388af15b7f9f9c4e0986ad31aaca, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696539696343.0a93388af15b7f9f9c4e0986ad31aaca.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2a36ffdf61175d997b5aec29b99fece4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696539696343.2a36ffdf61175d997b5aec29b99fece4.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 21:01:51,630 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-05 21:01:51,630 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696539711630"}]},"ts":"9223372036854775807"} 2023-10-05 21:01:51,632 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-05 21:01:51,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-10-05 21:01:51,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 21:01:51,711 INFO [Listener at jenkins-hbase4.apache.org/40083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-05 21:01:51,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 21:01:51,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 21:01:51,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33411] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 21:01:51,748 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=918 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=5520 (was 5624) 2023-10-05 21:01:51,748 WARN [Listener at jenkins-hbase4.apache.org/40083] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 21:01:51,748 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-05 21:01:51,757 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 21:01:51,868 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696539607178_0007_01_000001 is : 143 2023-10-05 21:01:57,035 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 21:02:05,881 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 21:02:19,997 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 21:02:19,998 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 21:02:20,105 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-05 21:02:20,114 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-05 21:02:20,115 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 21:02:20,121 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 21:02:20,225 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 21:02:20,225 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-05 21:02:20,225 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-05 21:02:20,225 INFO [Listener at jenkins-hbase4.apache.org/40083] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-05 21:02:20,225 DEBUG [Listener at jenkins-hbase4.apache.org/40083] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42c4a367 to 127.0.0.1:54534 2023-10-05 21:02:20,225 DEBUG [Listener at jenkins-hbase4.apache.org/40083] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,226 DEBUG [Listener at jenkins-hbase4.apache.org/40083] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-05 21:02:20,226 DEBUG [Listener at jenkins-hbase4.apache.org/40083] util.JVMClusterUtil(257): Found active master hash=1336469339, stopped=false 2023-10-05 21:02:20,226 DEBUG [Listener at jenkins-hbase4.apache.org/40083] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,226 DEBUG [Listener at jenkins-hbase4.apache.org/40083] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 21:02:20,226 INFO [Listener at jenkins-hbase4.apache.org/40083] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:02:20,228 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 21:02:20,228 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 21:02:20,228 INFO [Listener at jenkins-hbase4.apache.org/40083] procedure2.ProcedureExecutor(628): Stopping 2023-10-05 21:02:20,228 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:02:20,228 DEBUG [Listener at jenkins-hbase4.apache.org/40083] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e636e72 to 127.0.0.1:54534 2023-10-05 21:02:20,228 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 21:02:20,228 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 21:02:20,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:02:20,228 DEBUG [Listener at jenkins-hbase4.apache.org/40083] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:02:20,228 INFO [Listener at jenkins-hbase4.apache.org/40083] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37883,1696539600708' ***** 2023-10-05 21:02:20,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:02:20,229 DEBUG [Listener at jenkins-hbase4.apache.org/40083] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 21:02:20,229 INFO [Listener at jenkins-hbase4.apache.org/40083] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 21:02:20,229 INFO [Listener at jenkins-hbase4.apache.org/40083] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34111,1696539600754' ***** 2023-10-05 21:02:20,229 DEBUG [Listener at jenkins-hbase4.apache.org/40083] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,229 INFO [RS:0;jenkins-hbase4:37883] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 21:02:20,229 INFO [Listener at jenkins-hbase4.apache.org/40083] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 21:02:20,229 INFO [Listener at jenkins-hbase4.apache.org/40083] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35295,1696539600793' ***** 2023-10-05 21:02:20,229 INFO [RS:0;jenkins-hbase4:37883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 21:02:20,229 DEBUG [Listener at jenkins-hbase4.apache.org/40083] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,229 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 21:02:20,229 INFO [Listener at jenkins-hbase4.apache.org/40083] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 21:02:20,229 INFO [RS:0;jenkins-hbase4:37883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 21:02:20,229 INFO [RS:1;jenkins-hbase4:34111] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 21:02:20,230 INFO [RS:2;jenkins-hbase4:35295] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 21:02:20,230 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 21:02:20,230 INFO [RS:2;jenkins-hbase4:35295] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 21:02:20,230 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 21:02:20,230 INFO [RS:1;jenkins-hbase4:34111] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 21:02:20,230 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:02:20,230 INFO [RS:1;jenkins-hbase4:34111] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 21:02:20,230 DEBUG [RS:0;jenkins-hbase4:37883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x288326de to 127.0.0.1:54534 2023-10-05 21:02:20,230 INFO [RS:2;jenkins-hbase4:35295] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 21:02:20,230 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(3305): Received CLOSE for 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:02:20,230 DEBUG [RS:0;jenkins-hbase4:37883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,230 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(3305): Received CLOSE for e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:02:20,231 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:02:20,232 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37883,1696539600708; all regions closed. 2023-10-05 21:02:20,232 DEBUG [RS:1;jenkins-hbase4:34111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17400987 to 127.0.0.1:54534 2023-10-05 21:02:20,231 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:02:20,233 DEBUG [RS:2;jenkins-hbase4:35295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42baac64 to 127.0.0.1:54534 2023-10-05 21:02:20,233 DEBUG [RS:2;jenkins-hbase4:35295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0daea1c0daaf354f4392c12c612fe91, disabling compactions & flushes 2023-10-05 21:02:20,232 DEBUG [RS:1;jenkins-hbase4:34111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 613243e6a94c0d50f018962d57f5fd53, disabling compactions & flushes 2023-10-05 21:02:20,235 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 21:02:20,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:02:20,235 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1478): Online Regions={613243e6a94c0d50f018962d57f5fd53=hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53.} 2023-10-05 21:02:20,235 INFO [RS:2;jenkins-hbase4:35295] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 21:02:20,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:02:20,235 INFO [RS:2;jenkins-hbase4:35295] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 21:02:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:02:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:02:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. after waiting 0 ms 2023-10-05 21:02:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. after waiting 0 ms 2023-10-05 21:02:20,235 INFO [RS:2;jenkins-hbase4:35295] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 21:02:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:02:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:02:20,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 613243e6a94c0d50f018962d57f5fd53 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-05 21:02:20,236 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-05 21:02:20,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e0daea1c0daaf354f4392c12c612fe91 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-05 21:02:20,236 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-05 21:02:20,236 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, e0daea1c0daaf354f4392c12c612fe91=hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91.} 2023-10-05 21:02:20,236 DEBUG [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1504): Waiting on 613243e6a94c0d50f018962d57f5fd53 2023-10-05 21:02:20,236 DEBUG [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1504): Waiting on 1588230740, e0daea1c0daaf354f4392c12c612fe91 2023-10-05 21:02:20,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 21:02:20,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 21:02:20,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 21:02:20,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 21:02:20,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 21:02:20,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-05 21:02:20,253 DEBUG [RS:0;jenkins-hbase4:37883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs 2023-10-05 21:02:20,254 INFO [RS:0;jenkins-hbase4:37883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37883%2C1696539600708:(num 1696539602488) 2023-10-05 21:02:20,254 DEBUG [RS:0;jenkins-hbase4:37883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,254 INFO [RS:0;jenkins-hbase4:37883] regionserver.LeaseManager(133): Closed leases 2023-10-05 21:02:20,254 INFO [RS:0;jenkins-hbase4:37883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 21:02:20,254 INFO [RS:0;jenkins-hbase4:37883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 21:02:20,254 INFO [RS:0;jenkins-hbase4:37883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 21:02:20,254 INFO [RS:0;jenkins-hbase4:37883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 21:02:20,255 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 21:02:20,259 INFO [RS:0;jenkins-hbase4:37883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37883 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37883,1696539600708 2023-10-05 21:02:20,275 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 21:02:20,277 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/.tmp/info/b91827b4da7a460dae6e3f8a0cfbb886 2023-10-05 21:02:20,278 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37883,1696539600708] 2023-10-05 21:02:20,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/.tmp/info/01e9a03acf1c4fe594ad4a003352132d 2023-10-05 21:02:20,279 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37883,1696539600708; numProcessing=1 2023-10-05 21:02:20,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/.tmp/l/001a6b33526549cfa129c5c8907e9ea8 2023-10-05 21:02:20,280 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37883,1696539600708 already deleted, retry=false 2023-10-05 21:02:20,280 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37883,1696539600708 expired; onlineServers=2 2023-10-05 21:02:20,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b91827b4da7a460dae6e3f8a0cfbb886 2023-10-05 21:02:20,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 001a6b33526549cfa129c5c8907e9ea8 2023-10-05 21:02:20,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/.tmp/info/01e9a03acf1c4fe594ad4a003352132d as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/info/01e9a03acf1c4fe594ad4a003352132d 2023-10-05 21:02:20,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/.tmp/l/001a6b33526549cfa129c5c8907e9ea8 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/l/001a6b33526549cfa129c5c8907e9ea8 2023-10-05 21:02:20,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/info/01e9a03acf1c4fe594ad4a003352132d, entries=2, sequenceid=6, filesize=4.8 K 2023-10-05 21:02:20,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 001a6b33526549cfa129c5c8907e9ea8 2023-10-05 21:02:20,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/l/001a6b33526549cfa129c5c8907e9ea8, entries=7, sequenceid=18, filesize=5.2 K 2023-10-05 21:02:20,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 613243e6a94c0d50f018962d57f5fd53 in 54ms, sequenceid=6, compaction requested=false 2023-10-05 21:02:20,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e0daea1c0daaf354f4392c12c612fe91 in 54ms, sequenceid=18, compaction requested=false 2023-10-05 21:02:20,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/namespace/613243e6a94c0d50f018962d57f5fd53/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 21:02:20,305 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-05 21:02:20,305 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-05 21:02:20,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/acl/e0daea1c0daaf354f4392c12c612fe91/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-05 21:02:20,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:02:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 613243e6a94c0d50f018962d57f5fd53: 2023-10-05 21:02:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696539602981.613243e6a94c0d50f018962d57f5fd53. 2023-10-05 21:02:20,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/.tmp/rep_barrier/44f63cd6d21c457792eddb5685ce7be6 2023-10-05 21:02:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,307 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 21:02:20,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:02:20,307 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 21:02:20,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0daea1c0daaf354f4392c12c612fe91: 2023-10-05 21:02:20,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696539603744.e0daea1c0daaf354f4392c12c612fe91. 2023-10-05 21:02:20,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44f63cd6d21c457792eddb5685ce7be6 2023-10-05 21:02:20,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/.tmp/table/42c63d2072334e428f830a0a6392023d 2023-10-05 21:02:20,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42c63d2072334e428f830a0a6392023d 2023-10-05 21:02:20,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/.tmp/info/b91827b4da7a460dae6e3f8a0cfbb886 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/info/b91827b4da7a460dae6e3f8a0cfbb886 2023-10-05 21:02:20,328 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 21:02:20,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b91827b4da7a460dae6e3f8a0cfbb886 2023-10-05 21:02:20,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/info/b91827b4da7a460dae6e3f8a0cfbb886, entries=48, sequenceid=131, filesize=10.3 K 2023-10-05 21:02:20,329 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/.tmp/rep_barrier/44f63cd6d21c457792eddb5685ce7be6 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/rep_barrier/44f63cd6d21c457792eddb5685ce7be6 2023-10-05 21:02:20,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44f63cd6d21c457792eddb5685ce7be6 2023-10-05 21:02:20,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/rep_barrier/44f63cd6d21c457792eddb5685ce7be6, entries=13, sequenceid=131, filesize=6.4 K 2023-10-05 21:02:20,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/.tmp/table/42c63d2072334e428f830a0a6392023d as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/table/42c63d2072334e428f830a0a6392023d 2023-10-05 21:02:20,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42c63d2072334e428f830a0a6392023d 2023-10-05 21:02:20,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/table/42c63d2072334e428f830a0a6392023d, entries=24, sequenceid=131, filesize=6.9 K 2023-10-05 21:02:20,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 101ms, sequenceid=131, compaction requested=false 2023-10-05 21:02:20,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-05 21:02:20,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 21:02:20,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 21:02:20,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 21:02:20,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 21:02:20,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-05 21:02:20,355 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-05 21:02:20,355 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-05 21:02:20,379 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,379 INFO [RS:0;jenkins-hbase4:37883] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37883,1696539600708; zookeeper connection closed. 2023-10-05 21:02:20,379 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:37883-0x1011863166d0001, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,379 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@41fe38e2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@41fe38e2 2023-10-05 21:02:20,436 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34111,1696539600754; all regions closed. 2023-10-05 21:02:20,436 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35295,1696539600793; all regions closed. 2023-10-05 21:02:20,444 DEBUG [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs 2023-10-05 21:02:20,444 DEBUG [RS:1;jenkins-hbase4:34111] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs 2023-10-05 21:02:20,444 INFO [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35295%2C1696539600793.meta:.meta(num 1696539602692) 2023-10-05 21:02:20,444 INFO [RS:1;jenkins-hbase4:34111] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34111%2C1696539600754:(num 1696539602489) 2023-10-05 21:02:20,444 DEBUG [RS:1;jenkins-hbase4:34111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,444 INFO [RS:1;jenkins-hbase4:34111] regionserver.LeaseManager(133): Closed leases 2023-10-05 21:02:20,444 INFO [RS:1;jenkins-hbase4:34111] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 21:02:20,445 INFO [RS:1;jenkins-hbase4:34111] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 21:02:20,445 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 21:02:20,445 INFO [RS:1;jenkins-hbase4:34111] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 21:02:20,445 INFO [RS:1;jenkins-hbase4:34111] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 21:02:20,446 INFO [RS:1;jenkins-hbase4:34111] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34111 2023-10-05 21:02:20,448 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:02:20,451 DEBUG [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/oldWALs 2023-10-05 21:02:20,451 INFO [RS:2;jenkins-hbase4:35295] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35295%2C1696539600793:(num 1696539602489) 2023-10-05 21:02:20,451 DEBUG [RS:2;jenkins-hbase4:35295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,451 INFO [RS:2;jenkins-hbase4:35295] regionserver.LeaseManager(133): Closed leases 2023-10-05 21:02:20,451 INFO [RS:2;jenkins-hbase4:35295] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 21:02:20,452 INFO [RS:2;jenkins-hbase4:35295] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35295 2023-10-05 21:02:20,452 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 21:02:20,454 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34111,1696539600754 2023-10-05 21:02:20,454 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 21:02:20,456 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35295,1696539600793 2023-10-05 21:02:20,456 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35295,1696539600793] 2023-10-05 21:02:20,456 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35295,1696539600793; numProcessing=2 2023-10-05 21:02:20,458 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35295,1696539600793 already deleted, retry=false 2023-10-05 21:02:20,458 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35295,1696539600793 expired; onlineServers=1 2023-10-05 21:02:20,458 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34111,1696539600754] 2023-10-05 21:02:20,458 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34111,1696539600754; numProcessing=3 2023-10-05 21:02:20,460 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34111,1696539600754 already deleted, retry=false 2023-10-05 21:02:20,460 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34111,1696539600754 expired; onlineServers=0 2023-10-05 21:02:20,460 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33411,1696539599455' ***** 2023-10-05 21:02:20,460 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-05 21:02:20,460 DEBUG [M:0;jenkins-hbase4:33411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e95ed60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 21:02:20,460 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33411,1696539599455 2023-10-05 21:02:20,460 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33411,1696539599455; all regions closed. 2023-10-05 21:02:20,460 DEBUG [M:0;jenkins-hbase4:33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 21:02:20,460 DEBUG [M:0;jenkins-hbase4:33411] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-05 21:02:20,460 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-05 21:02:20,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696539602113] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696539602113,5,FailOnTimeoutGroup] 2023-10-05 21:02:20,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696539602117] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696539602117,5,FailOnTimeoutGroup] 2023-10-05 21:02:20,460 DEBUG [M:0;jenkins-hbase4:33411] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-05 21:02:20,461 INFO [M:0;jenkins-hbase4:33411] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-05 21:02:20,461 INFO [M:0;jenkins-hbase4:33411] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-05 21:02:20,461 INFO [M:0;jenkins-hbase4:33411] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-05 21:02:20,461 DEBUG [M:0;jenkins-hbase4:33411] master.HMaster(1512): Stopping service threads 2023-10-05 21:02:20,461 INFO [M:0;jenkins-hbase4:33411] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-05 21:02:20,461 ERROR [M:0;jenkins-hbase4:33411] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-05 21:02:20,462 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-05 21:02:20,462 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 21:02:20,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 21:02:20,463 INFO [M:0;jenkins-hbase4:33411] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-05 21:02:20,463 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-05 21:02:20,463 DEBUG [M:0;jenkins-hbase4:33411] zookeeper.ZKUtil(398): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-05 21:02:20,463 WARN [M:0;jenkins-hbase4:33411] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-05 21:02:20,463 INFO [M:0;jenkins-hbase4:33411] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-05 21:02:20,463 INFO [M:0;jenkins-hbase4:33411] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-05 21:02:20,464 DEBUG [M:0;jenkins-hbase4:33411] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 21:02:20,464 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:02:20,464 DEBUG [M:0;jenkins-hbase4:33411] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:02:20,464 DEBUG [M:0;jenkins-hbase4:33411] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 21:02:20,464 DEBUG [M:0;jenkins-hbase4:33411] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:02:20,464 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.85 KB heapSize=452.13 KB 2023-10-05 21:02:20,476 INFO [M:0;jenkins-hbase4:33411] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.85 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3e3a8e9e79084cf691d37095081c6479 2023-10-05 21:02:20,480 INFO [M:0;jenkins-hbase4:33411] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e3a8e9e79084cf691d37095081c6479 2023-10-05 21:02:20,481 DEBUG [M:0;jenkins-hbase4:33411] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3e3a8e9e79084cf691d37095081c6479 as hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3e3a8e9e79084cf691d37095081c6479 2023-10-05 21:02:20,484 INFO [M:0;jenkins-hbase4:33411] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e3a8e9e79084cf691d37095081c6479 2023-10-05 21:02:20,484 INFO [M:0;jenkins-hbase4:33411] regionserver.HStore(1080): Added hdfs://localhost:43021/user/jenkins/test-data/38c31e7c-d1db-5afd-93bb-e93a9819596d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3e3a8e9e79084cf691d37095081c6479, entries=119, sequenceid=899, filesize=28.7 K 2023-10-05 21:02:20,485 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegion(2948): Finished flush of dataSize ~375.85 KB/384875, heapSize ~452.11 KB/462960, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-05 21:02:20,486 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 21:02:20,486 DEBUG [M:0;jenkins-hbase4:33411] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 21:02:20,490 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 21:02:20,490 INFO [M:0;jenkins-hbase4:33411] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-05 21:02:20,490 INFO [M:0;jenkins-hbase4:33411] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33411 2023-10-05 21:02:20,492 DEBUG [M:0;jenkins-hbase4:33411] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33411,1696539599455 already deleted, retry=false 2023-10-05 21:02:20,549 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,549 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:34111-0x1011863166d0002, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,549 INFO [RS:1;jenkins-hbase4:34111] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34111,1696539600754; zookeeper connection closed. 2023-10-05 21:02:20,550 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@14c3821d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@14c3821d 2023-10-05 21:02:20,649 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,649 INFO [M:0;jenkins-hbase4:33411] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33411,1696539599455; zookeeper connection closed. 2023-10-05 21:02:20,650 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): master:33411-0x1011863166d0000, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,750 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,750 DEBUG [Listener at localhost/44419-EventThread] zookeeper.ZKWatcher(600): regionserver:35295-0x1011863166d0003, quorum=127.0.0.1:54534, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 21:02:20,750 INFO [RS:2;jenkins-hbase4:35295] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35295,1696539600793; zookeeper connection closed. 2023-10-05 21:02:20,750 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@51656425] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@51656425 2023-10-05 21:02:20,750 INFO [Listener at jenkins-hbase4.apache.org/40083] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-05 21:02:20,751 WARN [Listener at jenkins-hbase4.apache.org/40083] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 21:02:20,753 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 21:02:20,856 WARN [BP-1576340739-172.31.14.131-1696539596170 heartbeating to localhost/127.0.0.1:43021] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 21:02:20,856 WARN [BP-1576340739-172.31.14.131-1696539596170 heartbeating to localhost/127.0.0.1:43021] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1576340739-172.31.14.131-1696539596170 (Datanode Uuid 54d6a243-704b-407f-b73d-4b7cbc495bc8) service to localhost/127.0.0.1:43021 2023-10-05 21:02:20,858 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data5/current/BP-1576340739-172.31.14.131-1696539596170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 21:02:20,858 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data6/current/BP-1576340739-172.31.14.131-1696539596170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 21:02:20,858 WARN [Listener at jenkins-hbase4.apache.org/40083] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 21:02:20,860 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 21:02:20,964 WARN [BP-1576340739-172.31.14.131-1696539596170 heartbeating to localhost/127.0.0.1:43021] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 21:02:20,964 WARN [BP-1576340739-172.31.14.131-1696539596170 heartbeating to localhost/127.0.0.1:43021] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1576340739-172.31.14.131-1696539596170 (Datanode Uuid 2947d646-253f-44fe-aa83-e4427667c081) service to localhost/127.0.0.1:43021 2023-10-05 21:02:20,964 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data3/current/BP-1576340739-172.31.14.131-1696539596170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 21:02:20,965 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data4/current/BP-1576340739-172.31.14.131-1696539596170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 21:02:20,965 WARN [Listener at jenkins-hbase4.apache.org/40083] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 21:02:20,967 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 21:02:21,070 WARN [BP-1576340739-172.31.14.131-1696539596170 heartbeating to localhost/127.0.0.1:43021] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 21:02:21,070 WARN [BP-1576340739-172.31.14.131-1696539596170 heartbeating to localhost/127.0.0.1:43021] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1576340739-172.31.14.131-1696539596170 (Datanode Uuid e8db1d55-aa60-48e8-b5c7-4942dac7b718) service to localhost/127.0.0.1:43021 2023-10-05 21:02:21,071 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data1/current/BP-1576340739-172.31.14.131-1696539596170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 21:02:21,086 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9915ab5c-5901-eef5-306d-57fd5f056409/cluster_b108e739-f4ae-2e85-eab0-8ccad76a4e81/dfs/data/data2/current/BP-1576340739-172.31.14.131-1696539596170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 21:02:21,106 INFO [Listener at jenkins-hbase4.apache.org/40083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 21:02:21,233 INFO [Listener at jenkins-hbase4.apache.org/40083] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-05 21:02:21,316 INFO [Listener at jenkins-hbase4.apache.org/40083] hbase.HBaseTestingUtility(1293): Minicluster is down