2023-07-16 22:10:45,055 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 22:10:45,299 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da 2023-07-16 22:10:45,299 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-16 22:10:45,347 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 22:10:45,604 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 22:10:45,604 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba, deleteOnExit=true 2023-07-16 22:10:45,604 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 22:10:45,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/test.cache.data in system properties and HBase conf 2023-07-16 22:10:45,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 22:10:45,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop.log.dir in system properties and HBase conf 2023-07-16 22:10:45,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 22:10:45,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 22:10:45,606 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 22:10:45,949 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 22:10:45,955 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:45,956 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:45,956 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 22:10:45,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:45,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 22:10:45,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 22:10:45,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:45,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:45,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 22:10:45,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/nfs.dump.dir in system properties and HBase conf 2023-07-16 22:10:45,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir in system properties and HBase conf 2023-07-16 22:10:45,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:45,961 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 22:10:45,961 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 22:10:46,553 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 22:10:46,557 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 22:10:46,838 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 22:10:47,028 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 22:10:47,045 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:47,084 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:47,121 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_localhost_46193_hdfs____.k900zx/webapp 2023-07-16 22:10:47,268 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46193 2023-07-16 22:10:47,308 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 22:10:47,308 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 22:10:47,848 WARN [Listener at localhost/40683] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:47,943 WARN [Listener at localhost/40683] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 22:10:47,969 WARN [Listener at localhost/40683] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:47,977 INFO [Listener at localhost/40683] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:47,985 INFO [Listener at localhost/40683] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_localhost_41069_datanode____.i3ykeb/webapp 2023-07-16 22:10:48,137 INFO [Listener at localhost/40683] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41069 2023-07-16 22:10:48,673 WARN [Listener at localhost/33739] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:48,713 WARN [Listener at localhost/33739] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 22:10:48,722 WARN [Listener at localhost/33739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:48,725 INFO [Listener at localhost/33739] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:48,733 INFO [Listener at localhost/33739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_localhost_44163_datanode____altt79/webapp 2023-07-16 22:10:48,883 INFO [Listener at localhost/33739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44163 2023-07-16 22:10:48,926 WARN [Listener at localhost/37911] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:49,050 WARN [Listener at localhost/37911] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 22:10:49,059 WARN [Listener at localhost/37911] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:49,061 INFO [Listener at localhost/37911] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:49,070 INFO [Listener at localhost/37911] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_localhost_42979_datanode____.nm8irg/webapp 2023-07-16 22:10:49,243 INFO [Listener at localhost/37911] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42979 2023-07-16 22:10:49,269 WARN [Listener at localhost/42683] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:49,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ca461cc2bd66343: Processing first storage report for DS-59e6dbad-bf54-42b5-826a-79a3824477ad from datanode 8a90241b-7005-468c-b8d3-317cf41b3c95 2023-07-16 22:10:49,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ca461cc2bd66343: from storage DS-59e6dbad-bf54-42b5-826a-79a3824477ad node DatanodeRegistration(127.0.0.1:43171, datanodeUuid=8a90241b-7005-468c-b8d3-317cf41b3c95, infoPort=44939, infoSecurePort=0, ipcPort=37911, storageInfo=lv=-57;cid=testClusterID;nsid=242441081;c=1689545446625), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,398 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x671799b2d3f129b7: Processing first storage report for DS-36c2a005-6c2e-40a7-9b67-ec013dff6918 from datanode ae818872-331e-4e73-be16-dc64f4fd747e 2023-07-16 22:10:49,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x671799b2d3f129b7: from storage DS-36c2a005-6c2e-40a7-9b67-ec013dff6918 node DatanodeRegistration(127.0.0.1:41337, datanodeUuid=ae818872-331e-4e73-be16-dc64f4fd747e, infoPort=37747, infoSecurePort=0, ipcPort=33739, storageInfo=lv=-57;cid=testClusterID;nsid=242441081;c=1689545446625), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,398 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ca461cc2bd66343: Processing first storage report for DS-2f97c539-e381-487d-b95c-a21a9774fa40 from datanode 8a90241b-7005-468c-b8d3-317cf41b3c95 2023-07-16 22:10:49,399 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ca461cc2bd66343: from storage DS-2f97c539-e381-487d-b95c-a21a9774fa40 node DatanodeRegistration(127.0.0.1:43171, datanodeUuid=8a90241b-7005-468c-b8d3-317cf41b3c95, infoPort=44939, infoSecurePort=0, ipcPort=37911, storageInfo=lv=-57;cid=testClusterID;nsid=242441081;c=1689545446625), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,399 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x671799b2d3f129b7: Processing first storage report for DS-0a21d0a7-a8b9-485d-bd1a-93e9aad9b6fc from datanode ae818872-331e-4e73-be16-dc64f4fd747e 2023-07-16 22:10:49,399 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x671799b2d3f129b7: from storage DS-0a21d0a7-a8b9-485d-bd1a-93e9aad9b6fc node DatanodeRegistration(127.0.0.1:41337, datanodeUuid=ae818872-331e-4e73-be16-dc64f4fd747e, infoPort=37747, infoSecurePort=0, ipcPort=33739, storageInfo=lv=-57;cid=testClusterID;nsid=242441081;c=1689545446625), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,547 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf93bddd51c81c3fe: Processing first storage report for DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6 from datanode e76470e9-6f8a-46c2-bcd1-f9cc454bc7b4 2023-07-16 22:10:49,548 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf93bddd51c81c3fe: from storage DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6 node DatanodeRegistration(127.0.0.1:41287, datanodeUuid=e76470e9-6f8a-46c2-bcd1-f9cc454bc7b4, infoPort=35441, infoSecurePort=0, ipcPort=42683, storageInfo=lv=-57;cid=testClusterID;nsid=242441081;c=1689545446625), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,548 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf93bddd51c81c3fe: Processing first storage report for DS-71fc811d-9b98-4078-a4b0-72b449badf85 from datanode e76470e9-6f8a-46c2-bcd1-f9cc454bc7b4 2023-07-16 22:10:49,548 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf93bddd51c81c3fe: from storage DS-71fc811d-9b98-4078-a4b0-72b449badf85 node DatanodeRegistration(127.0.0.1:41287, datanodeUuid=e76470e9-6f8a-46c2-bcd1-f9cc454bc7b4, infoPort=35441, infoSecurePort=0, ipcPort=42683, storageInfo=lv=-57;cid=testClusterID;nsid=242441081;c=1689545446625), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,692 DEBUG [Listener at localhost/42683] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da 2023-07-16 22:10:49,776 INFO [Listener at localhost/42683] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/zookeeper_0, clientPort=63820, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 22:10:49,796 INFO [Listener at localhost/42683] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63820 2023-07-16 22:10:49,807 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:49,810 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:50,491 INFO [Listener at localhost/42683] util.FSUtils(471): Created version file at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 with version=8 2023-07-16 22:10:50,492 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/hbase-staging 2023-07-16 22:10:50,869 INFO [Listener at localhost/42683] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 22:10:51,523 INFO [Listener at localhost/42683] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:51,562 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:51,563 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:51,563 INFO [Listener at localhost/42683] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:51,564 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:51,564 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:51,756 INFO [Listener at localhost/42683] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:51,839 DEBUG [Listener at localhost/42683] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 22:10:51,952 INFO [Listener at localhost/42683] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35859 2023-07-16 22:10:51,971 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:51,974 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,004 INFO [Listener at localhost/42683] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35859 connecting to ZooKeeper ensemble=127.0.0.1:63820 2023-07-16 22:10:52,065 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:358590x0, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35859-0x101703024210000 connected 2023-07-16 22:10:52,108 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,109 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,122 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,130 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35859 2023-07-16 22:10:52,131 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35859 2023-07-16 22:10:52,131 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35859 2023-07-16 22:10:52,134 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35859 2023-07-16 22:10:52,142 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35859 2023-07-16 22:10:52,151 INFO [Listener at localhost/42683] master.HMaster(444): hbase.rootdir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, hbase.cluster.distributed=false 2023-07-16 22:10:52,227 INFO [Listener at localhost/42683] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:52,227 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,227 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,227 INFO [Listener at localhost/42683] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:52,227 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,227 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:52,232 INFO [Listener at localhost/42683] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:52,238 INFO [Listener at localhost/42683] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44505 2023-07-16 22:10:52,242 INFO [Listener at localhost/42683] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 22:10:52,264 DEBUG [Listener at localhost/42683] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 22:10:52,266 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,269 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,272 INFO [Listener at localhost/42683] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44505 connecting to ZooKeeper ensemble=127.0.0.1:63820 2023-07-16 22:10:52,280 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:445050x0, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44505-0x101703024210001 connected 2023-07-16 22:10:52,281 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,284 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,285 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,286 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44505 2023-07-16 22:10:52,286 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44505 2023-07-16 22:10:52,291 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44505 2023-07-16 22:10:52,294 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44505 2023-07-16 22:10:52,295 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44505 2023-07-16 22:10:52,314 INFO [Listener at localhost/42683] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:52,315 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,315 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,315 INFO [Listener at localhost/42683] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:52,316 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,316 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:52,316 INFO [Listener at localhost/42683] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:52,318 INFO [Listener at localhost/42683] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38355 2023-07-16 22:10:52,319 INFO [Listener at localhost/42683] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 22:10:52,322 DEBUG [Listener at localhost/42683] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 22:10:52,324 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,327 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,329 INFO [Listener at localhost/42683] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38355 connecting to ZooKeeper ensemble=127.0.0.1:63820 2023-07-16 22:10:52,335 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:383550x0, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,337 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:383550x0, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,341 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:383550x0, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,342 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:383550x0, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38355-0x101703024210002 connected 2023-07-16 22:10:52,351 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38355 2023-07-16 22:10:52,355 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38355 2023-07-16 22:10:52,358 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38355 2023-07-16 22:10:52,362 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38355 2023-07-16 22:10:52,363 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38355 2023-07-16 22:10:52,381 INFO [Listener at localhost/42683] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:52,381 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,382 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,382 INFO [Listener at localhost/42683] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:52,382 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,382 INFO [Listener at localhost/42683] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:52,382 INFO [Listener at localhost/42683] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:52,388 INFO [Listener at localhost/42683] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40577 2023-07-16 22:10:52,388 INFO [Listener at localhost/42683] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 22:10:52,398 DEBUG [Listener at localhost/42683] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 22:10:52,400 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,402 INFO [Listener at localhost/42683] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,404 INFO [Listener at localhost/42683] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40577 connecting to ZooKeeper ensemble=127.0.0.1:63820 2023-07-16 22:10:52,415 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:405770x0, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,416 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:405770x0, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,417 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:405770x0, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,418 DEBUG [Listener at localhost/42683] zookeeper.ZKUtil(164): regionserver:405770x0, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40577-0x101703024210003 connected 2023-07-16 22:10:52,423 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40577 2023-07-16 22:10:52,426 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40577 2023-07-16 22:10:52,427 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40577 2023-07-16 22:10:52,431 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40577 2023-07-16 22:10:52,434 DEBUG [Listener at localhost/42683] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40577 2023-07-16 22:10:52,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:52,460 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 22:10:52,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:52,490 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,490 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,490 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,490 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,490 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:52,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 22:10:52,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 22:10:52,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35859,1689545450683 from backup master directory 2023-07-16 22:10:52,504 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:52,504 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 22:10:52,505 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:52,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:52,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 22:10:52,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 22:10:52,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/hbase.id with ID: 9ac15f7d-507b-4b19-bac0-f1b4c5fa2e72 2023-07-16 22:10:52,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,722 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:52,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x16313f4f to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:52,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@474b78e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:52,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:52,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 22:10:52,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 22:10:52,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 22:10:52,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 22:10:52,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 22:10:52,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:52,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store-tmp 2023-07-16 22:10:53,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:53,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 22:10:53,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:53,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:53,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 22:10:53,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:53,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:53,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 22:10:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/WALs/jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:53,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35859%2C1689545450683, suffix=, logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/WALs/jenkins-hbase4.apache.org,35859,1689545450683, archiveDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/oldWALs, maxLogs=10 2023-07-16 22:10:53,125 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK] 2023-07-16 22:10:53,125 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK] 2023-07-16 22:10:53,124 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK] 2023-07-16 22:10:53,137 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 22:10:53,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/WALs/jenkins-hbase4.apache.org,35859,1689545450683/jenkins-hbase4.apache.org%2C35859%2C1689545450683.1689545453058 2023-07-16 22:10:53,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK], DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK]] 2023-07-16 22:10:53,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:53,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:53,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,329 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,336 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 22:10:53,375 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 22:10:53,392 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:53,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:53,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66095401, jitterRate=-0.015101775527000427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:10:53,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 22:10:53,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 22:10:53,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 22:10:53,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 22:10:53,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 22:10:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 22:10:53,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-07-16 22:10:53,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 22:10:53,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 22:10:53,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 22:10:53,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 22:10:53,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 22:10:53,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 22:10:53,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 22:10:53,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 22:10:53,626 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 22:10:53,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 22:10:53,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 22:10:53,650 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,650 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,650 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,650 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,650 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35859,1689545450683, sessionid=0x101703024210000, setting cluster-up flag (Was=false) 2023-07-16 22:10:53,677 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 22:10:53,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:53,702 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 22:10:53,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:53,719 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp 2023-07-16 22:10:53,743 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(951): ClusterId : 9ac15f7d-507b-4b19-bac0-f1b4c5fa2e72 2023-07-16 22:10:53,743 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(951): ClusterId : 9ac15f7d-507b-4b19-bac0-f1b4c5fa2e72 2023-07-16 22:10:53,751 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(951): ClusterId : 9ac15f7d-507b-4b19-bac0-f1b4c5fa2e72 2023-07-16 22:10:53,760 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 22:10:53,760 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 22:10:53,762 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 22:10:53,770 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 22:10:53,770 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 22:10:53,770 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 22:10:53,770 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 22:10:53,771 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 22:10:53,771 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 22:10:53,777 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 22:10:53,779 DEBUG [RS:1;jenkins-hbase4:38355] zookeeper.ReadOnlyZKClient(139): Connect 0x0ed4a1a8 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:53,783 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 22:10:53,787 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 22:10:53,800 DEBUG [RS:2;jenkins-hbase4:40577] zookeeper.ReadOnlyZKClient(139): Connect 0x2c8d9ebd to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:53,800 DEBUG [RS:0;jenkins-hbase4:44505] zookeeper.ReadOnlyZKClient(139): Connect 0x652e1d2e to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:53,812 DEBUG [RS:1;jenkins-hbase4:38355] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@259a07ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:53,813 DEBUG [RS:1;jenkins-hbase4:38355] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36e5e413, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:10:53,865 DEBUG [RS:2;jenkins-hbase4:40577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f7a6914, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:53,866 DEBUG [RS:2;jenkins-hbase4:40577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fd27b4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:10:53,867 DEBUG [RS:0;jenkins-hbase4:44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@202c9fef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:53,868 DEBUG [RS:0;jenkins-hbase4:44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c147932, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:10:53,876 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40577 2023-07-16 22:10:53,881 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44505 2023-07-16 22:10:53,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 22:10:53,884 INFO [RS:2;jenkins-hbase4:40577] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 22:10:53,884 INFO [RS:0;jenkins-hbase4:44505] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 22:10:53,884 INFO [RS:0;jenkins-hbase4:44505] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 22:10:53,884 INFO [RS:2;jenkins-hbase4:40577] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 22:10:53,893 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 22:10:53,893 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 22:10:53,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,895 INFO [RS:2;jenkins-hbase4:40577] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 22:10:53,895 INFO [RS:0;jenkins-hbase4:44505] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,896 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 22:10:53,896 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 22:10:53,898 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38355 2023-07-16 22:10:53,899 INFO [RS:1;jenkins-hbase4:38355] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 22:10:53,899 INFO [RS:1;jenkins-hbase4:38355] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 22:10:53,899 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 22:10:53,899 INFO [RS:1;jenkins-hbase4:38355] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,899 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 22:10:53,899 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35859,1689545450683 with isa=jenkins-hbase4.apache.org/172.31.14.131:40577, startcode=1689545452380 2023-07-16 22:10:53,900 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35859,1689545450683 with isa=jenkins-hbase4.apache.org/172.31.14.131:38355, startcode=1689545452313 2023-07-16 22:10:53,903 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35859,1689545450683 with isa=jenkins-hbase4.apache.org/172.31.14.131:44505, startcode=1689545452226 2023-07-16 22:10:53,926 DEBUG [RS:1;jenkins-hbase4:38355] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 22:10:53,928 DEBUG [RS:2;jenkins-hbase4:40577] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 22:10:53,926 DEBUG [RS:0;jenkins-hbase4:44505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 22:10:54,022 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53963, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 22:10:54,035 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59227, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 22:10:54,022 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35537, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 22:10:54,048 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35859] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 22:10:54,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 22:10:54,060 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35859] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 22:10:54,061 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35859] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 22:10:54,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:54,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:54,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:54,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:54,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 22:10:54,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689545484087 2023-07-16 22:10:54,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 22:10:54,093 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 22:10:54,093 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 22:10:54,093 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 22:10:54,094 WARN [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 22:10:54,094 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 22:10:54,094 WARN [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 22:10:54,094 WARN [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 22:10:54,094 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 22:10:54,102 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:54,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 22:10:54,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 22:10:54,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 22:10:54,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 22:10:54,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 22:10:54,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 22:10:54,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 22:10:54,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 22:10:54,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 22:10:54,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 22:10:54,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689545454140,5,FailOnTimeoutGroup] 2023-07-16 22:10:54,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689545454141,5,FailOnTimeoutGroup] 2023-07-16 22:10:54,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 22:10:54,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,198 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35859,1689545450683 with isa=jenkins-hbase4.apache.org/172.31.14.131:44505, startcode=1689545452226 2023-07-16 22:10:54,199 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35859,1689545450683 with isa=jenkins-hbase4.apache.org/172.31.14.131:38355, startcode=1689545452313 2023-07-16 22:10:54,199 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35859,1689545450683 with isa=jenkins-hbase4.apache.org/172.31.14.131:40577, startcode=1689545452380 2023-07-16 22:10:54,213 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:54,213 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35859] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,215 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:54,215 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:10:54,221 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35859] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,222 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35859] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,223 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:10:54,224 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40683 2023-07-16 22:10:54,224 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 22:10:54,224 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:10:54,225 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40683 2023-07-16 22:10:54,225 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 22:10:54,225 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:10:54,225 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40683 2023-07-16 22:10:54,225 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 22:10:54,236 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:10:54,236 DEBUG [RS:0;jenkins-hbase4:44505] zookeeper.ZKUtil(162): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,236 DEBUG [RS:2;jenkins-hbase4:40577] zookeeper.ZKUtil(162): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,236 DEBUG [RS:1;jenkins-hbase4:38355] zookeeper.ZKUtil(162): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,236 WARN [RS:0;jenkins-hbase4:44505] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:54,237 WARN [RS:2;jenkins-hbase4:40577] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:54,237 WARN [RS:1;jenkins-hbase4:38355] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:54,238 INFO [RS:0;jenkins-hbase4:44505] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:54,239 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40577,1689545452380] 2023-07-16 22:10:54,238 INFO [RS:2;jenkins-hbase4:40577] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:54,244 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,244 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,238 INFO [RS:1;jenkins-hbase4:38355] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:54,244 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,245 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44505,1689545452226] 2023-07-16 22:10:54,245 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38355,1689545452313] 2023-07-16 22:10:54,279 DEBUG [RS:2;jenkins-hbase4:40577] zookeeper.ZKUtil(162): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,279 DEBUG [RS:0;jenkins-hbase4:44505] zookeeper.ZKUtil(162): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,279 DEBUG [RS:2;jenkins-hbase4:40577] zookeeper.ZKUtil(162): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,281 DEBUG [RS:1;jenkins-hbase4:38355] zookeeper.ZKUtil(162): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,281 DEBUG [RS:2;jenkins-hbase4:40577] zookeeper.ZKUtil(162): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,283 DEBUG [RS:1;jenkins-hbase4:38355] zookeeper.ZKUtil(162): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,283 DEBUG [RS:0;jenkins-hbase4:44505] zookeeper.ZKUtil(162): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,284 DEBUG [RS:1;jenkins-hbase4:38355] zookeeper.ZKUtil(162): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,285 DEBUG [RS:0;jenkins-hbase4:44505] zookeeper.ZKUtil(162): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,288 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:54,300 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 22:10:54,300 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 22:10:54,300 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 22:10:54,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 22:10:54,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/info 2023-07-16 22:10:54,306 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 22:10:54,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:54,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 22:10:54,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/rep_barrier 2023-07-16 22:10:54,312 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 22:10:54,313 INFO [RS:0;jenkins-hbase4:44505] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 22:10:54,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:54,316 INFO [RS:2;jenkins-hbase4:40577] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 22:10:54,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 22:10:54,313 INFO [RS:1;jenkins-hbase4:38355] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 22:10:54,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/table 2023-07-16 22:10:54,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 22:10:54,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:54,337 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740 2023-07-16 22:10:54,340 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740 2023-07-16 22:10:54,346 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 22:10:54,348 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 22:10:54,357 INFO [RS:0;jenkins-hbase4:44505] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 22:10:54,363 INFO [RS:2;jenkins-hbase4:40577] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 22:10:54,364 INFO [RS:1;jenkins-hbase4:38355] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 22:10:54,367 INFO [RS:0;jenkins-hbase4:44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 22:10:54,367 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,368 INFO [RS:1;jenkins-hbase4:38355] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 22:10:54,368 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,369 INFO [RS:2;jenkins-hbase4:40577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 22:10:54,369 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,376 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 22:10:54,386 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 22:10:54,387 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:54,388 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61361221, jitterRate=-0.08564655482769012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 22:10:54,389 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 22:10:54,389 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 22:10:54,389 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 22:10:54,389 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 22:10:54,389 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 22:10:54,389 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 22:10:54,399 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 22:10:54,400 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 22:10:54,400 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 22:10:54,413 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 22:10:54,413 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 22:10:54,414 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,414 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,414 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,414 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,414 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,415 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,416 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,415 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:0;jenkins-hbase4:44505] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:2;jenkins-hbase4:40577] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,416 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,417 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,417 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,417 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,417 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,417 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,417 DEBUG [RS:1;jenkins-hbase4:38355] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 22:10:54,431 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,431 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,431 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,442 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,443 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,443 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,454 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,457 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 22:10:54,457 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,457 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,467 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 22:10:54,468 INFO [RS:1;jenkins-hbase4:38355] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 22:10:54,469 INFO [RS:0;jenkins-hbase4:44505] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 22:10:54,477 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38355,1689545452313-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,479 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44505,1689545452226-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,480 INFO [RS:2;jenkins-hbase4:40577] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 22:10:54,480 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40577,1689545452380-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,503 INFO [RS:1;jenkins-hbase4:38355] regionserver.Replication(203): jenkins-hbase4.apache.org,38355,1689545452313 started 2023-07-16 22:10:54,503 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38355,1689545452313, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38355, sessionid=0x101703024210002 2023-07-16 22:10:54,503 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 22:10:54,503 DEBUG [RS:1;jenkins-hbase4:38355] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,504 DEBUG [RS:1;jenkins-hbase4:38355] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38355,1689545452313' 2023-07-16 22:10:54,504 DEBUG [RS:1;jenkins-hbase4:38355] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 22:10:54,504 DEBUG [RS:1;jenkins-hbase4:38355] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 22:10:54,505 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 22:10:54,505 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 22:10:54,505 DEBUG [RS:1;jenkins-hbase4:38355] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,505 DEBUG [RS:1;jenkins-hbase4:38355] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38355,1689545452313' 2023-07-16 22:10:54,505 DEBUG [RS:1;jenkins-hbase4:38355] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:10:54,506 DEBUG [RS:1;jenkins-hbase4:38355] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:10:54,507 DEBUG [RS:1;jenkins-hbase4:38355] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 22:10:54,507 INFO [RS:1;jenkins-hbase4:38355] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 22:10:54,507 INFO [RS:1;jenkins-hbase4:38355] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 22:10:54,510 INFO [RS:0;jenkins-hbase4:44505] regionserver.Replication(203): jenkins-hbase4.apache.org,44505,1689545452226 started 2023-07-16 22:10:54,511 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44505,1689545452226, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44505, sessionid=0x101703024210001 2023-07-16 22:10:54,511 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 22:10:54,511 DEBUG [RS:0;jenkins-hbase4:44505] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,512 DEBUG [RS:0;jenkins-hbase4:44505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44505,1689545452226' 2023-07-16 22:10:54,517 DEBUG [RS:0;jenkins-hbase4:44505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 22:10:54,518 DEBUG [RS:0;jenkins-hbase4:44505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 22:10:54,519 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 22:10:54,519 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 22:10:54,519 DEBUG [RS:0;jenkins-hbase4:44505] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:54,523 INFO [RS:2;jenkins-hbase4:40577] regionserver.Replication(203): jenkins-hbase4.apache.org,40577,1689545452380 started 2023-07-16 22:10:54,523 DEBUG [RS:0;jenkins-hbase4:44505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44505,1689545452226' 2023-07-16 22:10:54,523 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40577,1689545452380, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40577, sessionid=0x101703024210003 2023-07-16 22:10:54,523 DEBUG [RS:0;jenkins-hbase4:44505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:10:54,524 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 22:10:54,524 DEBUG [RS:2;jenkins-hbase4:40577] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,524 DEBUG [RS:2;jenkins-hbase4:40577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40577,1689545452380' 2023-07-16 22:10:54,524 DEBUG [RS:2;jenkins-hbase4:40577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 22:10:54,524 DEBUG [RS:0;jenkins-hbase4:44505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:10:54,525 DEBUG [RS:2;jenkins-hbase4:40577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 22:10:54,525 DEBUG [RS:0;jenkins-hbase4:44505] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 22:10:54,525 INFO [RS:0;jenkins-hbase4:44505] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 22:10:54,526 INFO [RS:0;jenkins-hbase4:44505] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 22:10:54,527 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 22:10:54,527 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 22:10:54,527 DEBUG [RS:2;jenkins-hbase4:40577] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:54,527 DEBUG [RS:2;jenkins-hbase4:40577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40577,1689545452380' 2023-07-16 22:10:54,527 DEBUG [RS:2;jenkins-hbase4:40577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:10:54,528 DEBUG [RS:2;jenkins-hbase4:40577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:10:54,529 DEBUG [RS:2;jenkins-hbase4:40577] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 22:10:54,529 INFO [RS:2;jenkins-hbase4:40577] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 22:10:54,529 INFO [RS:2;jenkins-hbase4:40577] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 22:10:54,619 INFO [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38355%2C1689545452313, suffix=, logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,38355,1689545452313, archiveDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs, maxLogs=32 2023-07-16 22:10:54,619 DEBUG [jenkins-hbase4:35859] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 22:10:54,625 DEBUG [jenkins-hbase4:35859] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:10:54,630 INFO [RS:0;jenkins-hbase4:44505] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44505%2C1689545452226, suffix=, logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,44505,1689545452226, archiveDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs, maxLogs=32 2023-07-16 22:10:54,633 INFO [RS:2;jenkins-hbase4:40577] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40577%2C1689545452380, suffix=, logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,40577,1689545452380, archiveDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs, maxLogs=32 2023-07-16 22:10:54,646 DEBUG [jenkins-hbase4:35859] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:10:54,646 DEBUG [jenkins-hbase4:35859] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:10:54,646 DEBUG [jenkins-hbase4:35859] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:10:54,646 DEBUG [jenkins-hbase4:35859] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:10:54,656 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38355,1689545452313, state=OPENING 2023-07-16 22:10:54,679 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 22:10:54,682 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:54,685 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 22:10:54,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:10:54,696 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK] 2023-07-16 22:10:54,697 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK] 2023-07-16 22:10:54,704 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK] 2023-07-16 22:10:54,705 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK] 2023-07-16 22:10:54,708 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK] 2023-07-16 22:10:54,709 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK] 2023-07-16 22:10:54,710 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK] 2023-07-16 22:10:54,710 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK] 2023-07-16 22:10:54,710 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK] 2023-07-16 22:10:54,732 INFO [RS:2;jenkins-hbase4:40577] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,40577,1689545452380/jenkins-hbase4.apache.org%2C40577%2C1689545452380.1689545454635 2023-07-16 22:10:54,732 INFO [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,38355,1689545452313/jenkins-hbase4.apache.org%2C38355%2C1689545452313.1689545454623 2023-07-16 22:10:54,732 INFO [RS:0;jenkins-hbase4:44505] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,44505,1689545452226/jenkins-hbase4.apache.org%2C44505%2C1689545452226.1689545454633 2023-07-16 22:10:54,733 DEBUG [RS:2;jenkins-hbase4:40577] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK], DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK], DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK]] 2023-07-16 22:10:54,733 DEBUG [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK], DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK]] 2023-07-16 22:10:54,733 DEBUG [RS:0;jenkins-hbase4:44505] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK], DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK]] 2023-07-16 22:10:54,912 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:10:54,915 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:10:54,919 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:10:54,937 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 22:10:54,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:54,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38355%2C1689545452313.meta, suffix=.meta, logDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,38355,1689545452313, archiveDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs, maxLogs=32 2023-07-16 22:10:54,981 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK] 2023-07-16 22:10:54,984 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK] 2023-07-16 22:10:54,988 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK] 2023-07-16 22:10:54,997 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/WALs/jenkins-hbase4.apache.org,38355,1689545452313/jenkins-hbase4.apache.org%2C38355%2C1689545452313.meta.1689545454949.meta 2023-07-16 22:10:54,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK], DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK]] 2023-07-16 22:10:54,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:54,999 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 22:10:55,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:55,002 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 22:10:55,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 22:10:55,006 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 22:10:55,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 22:10:55,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:55,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 22:10:55,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 22:10:55,024 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 22:10:55,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/info 2023-07-16 22:10:55,029 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/info 2023-07-16 22:10:55,030 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 22:10:55,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:55,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 22:10:55,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/rep_barrier 2023-07-16 22:10:55,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/rep_barrier 2023-07-16 22:10:55,034 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 22:10:55,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:55,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 22:10:55,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/table 2023-07-16 22:10:55,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/table 2023-07-16 22:10:55,038 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 22:10:55,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:55,041 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740 2023-07-16 22:10:55,050 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740 2023-07-16 22:10:55,054 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 22:10:55,057 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 22:10:55,058 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66146241, jitterRate=-0.014344200491905212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 22:10:55,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 22:10:55,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689545454904 2023-07-16 22:10:55,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 22:10:55,103 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 22:10:55,103 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38355,1689545452313, state=OPEN 2023-07-16 22:10:55,108 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 22:10:55,108 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 22:10:55,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 22:10:55,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38355,1689545452313 in 419 msec 2023-07-16 22:10:55,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 22:10:55,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 687 msec 2023-07-16 22:10:55,125 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2190 sec 2023-07-16 22:10:55,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689545455125, completionTime=-1 2023-07-16 22:10:55,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 22:10:55,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 22:10:55,212 DEBUG [hconnection-0x70a6a56c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:10:55,215 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:10:55,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 22:10:55,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689545515237 2023-07-16 22:10:55,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689545575237 2023-07-16 22:10:55,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-07-16 22:10:55,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35859,1689545450683-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:55,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35859,1689545450683-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:55,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35859,1689545450683-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:55,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35859, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:55,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:55,276 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 22:10:55,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 22:10:55,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:55,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 22:10:55,305 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:10:55,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:10:55,340 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,342 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8 empty. 2023-07-16 22:10:55,343 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,343 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 22:10:55,393 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:55,396 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a4c2e323cf1aa04155615b8252d3f5d8, NAME => 'hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:10:55,414 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:55,414 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a4c2e323cf1aa04155615b8252d3f5d8, disabling compactions & flushes 2023-07-16 22:10:55,414 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,414 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,414 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. after waiting 0 ms 2023-07-16 22:10:55,414 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,414 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,415 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a4c2e323cf1aa04155615b8252d3f5d8: 2023-07-16 22:10:55,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:10:55,437 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689545455423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545455423"}]},"ts":"1689545455423"} 2023-07-16 22:10:55,468 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 22:10:55,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:10:55,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545455470"}]},"ts":"1689545455470"} 2023-07-16 22:10:55,481 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 22:10:55,488 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:10:55,490 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:10:55,490 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:10:55,490 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:10:55,490 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:10:55,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a4c2e323cf1aa04155615b8252d3f5d8, ASSIGN}] 2023-07-16 22:10:55,501 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a4c2e323cf1aa04155615b8252d3f5d8, ASSIGN 2023-07-16 22:10:55,503 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a4c2e323cf1aa04155615b8252d3f5d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:10:55,656 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 22:10:55,658 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a4c2e323cf1aa04155615b8252d3f5d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:55,658 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689545455657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545455657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545455657"}]},"ts":"1689545455657"} 2023-07-16 22:10:55,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a4c2e323cf1aa04155615b8252d3f5d8, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:10:55,819 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:55,819 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:10:55,823 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:10:55,832 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4c2e323cf1aa04155615b8252d3f5d8, NAME => 'hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:55,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. service=AccessControlService 2023-07-16 22:10:55,833 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:55,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:55,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,839 INFO [StoreOpener-a4c2e323cf1aa04155615b8252d3f5d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,842 DEBUG [StoreOpener-a4c2e323cf1aa04155615b8252d3f5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/info 2023-07-16 22:10:55,843 DEBUG [StoreOpener-a4c2e323cf1aa04155615b8252d3f5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/info 2023-07-16 22:10:55,843 INFO [StoreOpener-a4c2e323cf1aa04155615b8252d3f5d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4c2e323cf1aa04155615b8252d3f5d8 columnFamilyName info 2023-07-16 22:10:55,846 INFO [StoreOpener-a4c2e323cf1aa04155615b8252d3f5d8-1] regionserver.HStore(310): Store=a4c2e323cf1aa04155615b8252d3f5d8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:55,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:10:55,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:55,865 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a4c2e323cf1aa04155615b8252d3f5d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72143324, jitterRate=0.07501929998397827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:10:55,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a4c2e323cf1aa04155615b8252d3f5d8: 2023-07-16 22:10:55,867 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8., pid=6, masterSystemTime=1689545455819 2023-07-16 22:10:55,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:10:55,882 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a4c2e323cf1aa04155615b8252d3f5d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:10:55,882 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689545455881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545455881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545455881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545455881"}]},"ts":"1689545455881"} 2023-07-16 22:10:55,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 22:10:55,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a4c2e323cf1aa04155615b8252d3f5d8, server=jenkins-hbase4.apache.org,40577,1689545452380 in 225 msec 2023-07-16 22:10:55,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 22:10:55,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a4c2e323cf1aa04155615b8252d3f5d8, ASSIGN in 399 msec 2023-07-16 22:10:55,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:10:55,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545455901"}]},"ts":"1689545455901"} 2023-07-16 22:10:55,904 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 22:10:55,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 22:10:55,909 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:10:55,911 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 22:10:55,911 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:55,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 617 msec 2023-07-16 22:10:55,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:10:55,939 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:10:55,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 22:10:55,977 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 22:10:55,981 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 22:10:55,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-16 22:10:56,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 22:10:56,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 22:10:56,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-07-16 22:10:56,038 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 22:10:56,042 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 22:10:56,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.537sec 2023-07-16 22:10:56,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 22:10:56,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 22:10:56,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 22:10:56,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35859,1689545450683-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 22:10:56,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35859,1689545450683-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 22:10:56,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:56,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 22:10:56,078 DEBUG [Listener at localhost/42683] zookeeper.ReadOnlyZKClient(139): Connect 0x7b4bf029 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:56,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:10:56,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:10:56,087 DEBUG [Listener at localhost/42683] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1370d70b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:56,090 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 22:10:56,092 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768 empty. 2023-07-16 22:10:56,096 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,096 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 22:10:56,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:56,108 DEBUG [hconnection-0x226ad64-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:10:56,127 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:56,128 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:10:56,129 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f2ccdabdc33f0a32536c3c50eec21768, NAME => 'hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:10:56,136 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:10:56,136 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 22:10:56,136 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/test.cache.data in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop.log.dir in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:56,137 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/nfs.dump.dir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir in system properties and HBase conf 2023-07-16 22:10:56,138 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:56,139 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 22:10:56,139 INFO [Listener at localhost/42683] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 22:10:56,167 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:56,167 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f2ccdabdc33f0a32536c3c50eec21768, disabling compactions & flushes 2023-07-16 22:10:56,168 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,168 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,168 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. after waiting 0 ms 2023-07-16 22:10:56,168 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,168 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,168 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f2ccdabdc33f0a32536c3c50eec21768: 2023-07-16 22:10:56,173 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:10:56,175 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689545456174"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545456174"}]},"ts":"1689545456174"} 2023-07-16 22:10:56,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 22:10:56,180 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:10:56,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545456180"}]},"ts":"1689545456180"} 2023-07-16 22:10:56,185 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 22:10:56,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:10:56,198 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:10:56,198 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:10:56,199 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:10:56,199 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:10:56,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f2ccdabdc33f0a32536c3c50eec21768, ASSIGN}] 2023-07-16 22:10:56,204 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f2ccdabdc33f0a32536c3c50eec21768, ASSIGN 2023-07-16 22:10:56,208 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f2ccdabdc33f0a32536c3c50eec21768, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44505,1689545452226; forceNewPlan=false, retain=false 2023-07-16 22:10:56,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:56,358 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 22:10:56,359 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f2ccdabdc33f0a32536c3c50eec21768, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:56,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689545456359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545456359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545456359"}]},"ts":"1689545456359"} 2023-07-16 22:10:56,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f2ccdabdc33f0a32536c3c50eec21768, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:10:56,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:56,521 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:56,525 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:10:56,536 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:10:56,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2ccdabdc33f0a32536c3c50eec21768, NAME => 'hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:56,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. service=AccessControlService 2023-07-16 22:10:56,545 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:56,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:56,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,548 INFO [StoreOpener-f2ccdabdc33f0a32536c3c50eec21768-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,550 DEBUG [StoreOpener-f2ccdabdc33f0a32536c3c50eec21768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/l 2023-07-16 22:10:56,551 DEBUG [StoreOpener-f2ccdabdc33f0a32536c3c50eec21768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/l 2023-07-16 22:10:56,551 INFO [StoreOpener-f2ccdabdc33f0a32536c3c50eec21768-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2ccdabdc33f0a32536c3c50eec21768 columnFamilyName l 2023-07-16 22:10:56,552 INFO [StoreOpener-f2ccdabdc33f0a32536c3c50eec21768-1] regionserver.HStore(310): Store=f2ccdabdc33f0a32536c3c50eec21768/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:56,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:10:56,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:56,580 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2ccdabdc33f0a32536c3c50eec21768; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71711935, jitterRate=0.06859110295772552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:10:56,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2ccdabdc33f0a32536c3c50eec21768: 2023-07-16 22:10:56,583 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768., pid=11, masterSystemTime=1689545456521 2023-07-16 22:10:56,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,591 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:10:56,593 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f2ccdabdc33f0a32536c3c50eec21768, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:10:56,593 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689545456593"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545456593"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545456593"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545456593"}]},"ts":"1689545456593"} 2023-07-16 22:10:56,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 22:10:56,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f2ccdabdc33f0a32536c3c50eec21768, server=jenkins-hbase4.apache.org,44505,1689545452226 in 233 msec 2023-07-16 22:10:56,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 22:10:56,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f2ccdabdc33f0a32536c3c50eec21768, ASSIGN in 405 msec 2023-07-16 22:10:56,610 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:10:56,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545456610"}]},"ts":"1689545456610"} 2023-07-16 22:10:56,613 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 22:10:56,617 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:10:56,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 542 msec 2023-07-16 22:10:56,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:56,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 22:10:56,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 22:10:57,513 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:57,801 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:57,806 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35043_jobhistory____py7gqe/webapp 2023-07-16 22:10:57,975 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 22:10:57,975 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 22:10:57,975 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:10:57,977 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:10:58,051 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:58,373 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:58,753 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 22:10:58,795 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35043 2023-07-16 22:10:59,011 WARN [Listener at jenkins-hbase4.apache.org/33363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:59,447 WARN [Listener at jenkins-hbase4.apache.org/33363] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 22:10:59,448 INFO [Listener at jenkins-hbase4.apache.org/33363] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:59,477 INFO [Listener at jenkins-hbase4.apache.org/33363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37377_cluster____yoarit/webapp 2023-07-16 22:10:59,571 INFO [Listener at jenkins-hbase4.apache.org/33363] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 22:10:59,571 INFO [Listener at jenkins-hbase4.apache.org/33363] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 22:10:59,571 INFO [Listener at jenkins-hbase4.apache.org/33363] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:10:59,572 INFO [Listener at jenkins-hbase4.apache.org/33363] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:10:59,585 INFO [Listener at jenkins-hbase4.apache.org/33363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:59,846 INFO [Listener at jenkins-hbase4.apache.org/33363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:59,989 INFO [Listener at jenkins-hbase4.apache.org/33363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,000 INFO [Listener at jenkins-hbase4.apache.org/33363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37377 2023-07-16 22:11:00,626 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:00,630 WARN [Listener at jenkins-hbase4.apache.org/39681] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:11:00,679 WARN [Listener at jenkins-hbase4.apache.org/39681] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 22:11:00,680 INFO [Listener at jenkins-hbase4.apache.org/39681] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:11:00,694 INFO [Listener at jenkins-hbase4.apache.org/39681] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44323_node____c4778y/webapp 2023-07-16 22:11:00,784 INFO [Listener at jenkins-hbase4.apache.org/39681] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 22:11:00,784 INFO [Listener at jenkins-hbase4.apache.org/39681] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:11:00,784 INFO [Listener at jenkins-hbase4.apache.org/39681] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 22:11:00,785 INFO [Listener at jenkins-hbase4.apache.org/39681] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:11:00,792 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 22:11:00,796 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 22:11:00,797 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 22:11:00,802 INFO [Listener at jenkins-hbase4.apache.org/39681] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,836 INFO [Listener at jenkins-hbase4.apache.org/39681] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,865 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:00,866 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 22:11:00,866 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:00,866 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 22:11:00,867 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 22:11:00,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 22:11:00,867 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:00,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 22:11:00,867 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 22:11:00,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 22:11:00,946 INFO [Listener at jenkins-hbase4.apache.org/39681] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,963 INFO [Listener at jenkins-hbase4.apache.org/39681] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44323 2023-07-16 22:11:01,211 WARN [Listener at jenkins-hbase4.apache.org/40259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:11:01,217 WARN [Listener at jenkins-hbase4.apache.org/40259] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 22:11:01,218 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:11:01,224 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43883_node____.g1pp4e/webapp 2023-07-16 22:11:01,282 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 22:11:01,282 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:11:01,282 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 22:11:01,283 INFO [Listener at jenkins-hbase4.apache.org/40259] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:11:01,294 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:01,312 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:01,405 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:01,414 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43883 2023-07-16 22:11:01,445 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 22:11:01,447 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:01,520 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=711, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=175, AvailableMemoryMB=4634 2023-07-16 22:11:01,520 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=711 is superior to 500 2023-07-16 22:11:01,534 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 22:11:01,541 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 22:11:01,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:11:01,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:01,556 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:11:01,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 22:11:01,558 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:11:01,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:01,564 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:01,564 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:01,565 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 empty. 2023-07-16 22:11:01,565 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a empty. 2023-07-16 22:11:01,568 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:01,569 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:01,569 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 22:11:01,622 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 22:11:01,624 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9ef34cae92515bb02ad2df28597ad75, NAME => 'testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:11:01,625 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0690061e095fe5735522064dfd4b913a, NAME => 'testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:11:01,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:01,675 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:01,675 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:01,676 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0690061e095fe5735522064dfd4b913a, disabling compactions & flushes 2023-07-16 22:11:01,676 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f9ef34cae92515bb02ad2df28597ad75, disabling compactions & flushes 2023-07-16 22:11:01,676 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:01,676 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:01,676 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:01,676 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:01,676 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. after waiting 0 ms 2023-07-16 22:11:01,677 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. after waiting 0 ms 2023-07-16 22:11:01,677 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:01,677 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:01,677 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:01,677 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:01,677 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0690061e095fe5735522064dfd4b913a: 2023-07-16 22:11:01,677 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f9ef34cae92515bb02ad2df28597ad75: 2023-07-16 22:11:01,681 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:11:01,683 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545461683"}]},"ts":"1689545461683"} 2023-07-16 22:11:01,683 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545461683"}]},"ts":"1689545461683"} 2023-07-16 22:11:01,740 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:11:01,741 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:11:01,742 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545461741"}]},"ts":"1689545461741"} 2023-07-16 22:11:01,744 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 22:11:01,750 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:11:01,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:11:01,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:11:01,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:11:01,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:11:01,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, ASSIGN}] 2023-07-16 22:11:01,756 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, ASSIGN 2023-07-16 22:11:01,757 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, ASSIGN 2023-07-16 22:11:01,758 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:11:01,758 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44505,1689545452226; forceNewPlan=false, retain=false 2023-07-16 22:11:01,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:01,909 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:11:01,911 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f9ef34cae92515bb02ad2df28597ad75, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:01,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0690061e095fe5735522064dfd4b913a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:01,912 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545461911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545461911"}]},"ts":"1689545461911"} 2023-07-16 22:11:01,912 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545461911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545461911"}]},"ts":"1689545461911"} 2023-07-16 22:11:01,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure f9ef34cae92515bb02ad2df28597ad75, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:11:01,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 0690061e095fe5735522064dfd4b913a, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:11:02,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:02,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:02,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0690061e095fe5735522064dfd4b913a, NAME => 'testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:11:02,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9ef34cae92515bb02ad2df28597ad75, NAME => 'testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:11:02,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. service=AccessControlService 2023-07-16 22:11:02,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. service=AccessControlService 2023-07-16 22:11:02,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:02,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,078 INFO [StoreOpener-0690061e095fe5735522064dfd4b913a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,078 INFO [StoreOpener-f9ef34cae92515bb02ad2df28597ad75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,080 DEBUG [StoreOpener-0690061e095fe5735522064dfd4b913a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf 2023-07-16 22:11:02,080 DEBUG [StoreOpener-0690061e095fe5735522064dfd4b913a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf 2023-07-16 22:11:02,080 DEBUG [StoreOpener-f9ef34cae92515bb02ad2df28597ad75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf 2023-07-16 22:11:02,081 DEBUG [StoreOpener-f9ef34cae92515bb02ad2df28597ad75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf 2023-07-16 22:11:02,081 INFO [StoreOpener-0690061e095fe5735522064dfd4b913a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0690061e095fe5735522064dfd4b913a columnFamilyName cf 2023-07-16 22:11:02,081 INFO [StoreOpener-f9ef34cae92515bb02ad2df28597ad75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9ef34cae92515bb02ad2df28597ad75 columnFamilyName cf 2023-07-16 22:11:02,082 INFO [StoreOpener-0690061e095fe5735522064dfd4b913a-1] regionserver.HStore(310): Store=0690061e095fe5735522064dfd4b913a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:02,084 INFO [StoreOpener-f9ef34cae92515bb02ad2df28597ad75-1] regionserver.HStore(310): Store=f9ef34cae92515bb02ad2df28597ad75/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:02,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:02,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:02,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:02,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:02,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9ef34cae92515bb02ad2df28597ad75; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71625034, jitterRate=0.06729617714881897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:02,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9ef34cae92515bb02ad2df28597ad75: 2023-07-16 22:11:02,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0690061e095fe5735522064dfd4b913a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66917480, jitterRate=-0.00285184383392334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:02,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0690061e095fe5735522064dfd4b913a: 2023-07-16 22:11:02,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a., pid=16, masterSystemTime=1689545462069 2023-07-16 22:11:02,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75., pid=15, masterSystemTime=1689545462068 2023-07-16 22:11:02,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:02,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:02,115 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0690061e095fe5735522064dfd4b913a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,115 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545462115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545462115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545462115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545462115"}]},"ts":"1689545462115"} 2023-07-16 22:11:02,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:02,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:02,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f9ef34cae92515bb02ad2df28597ad75, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,122 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545462117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545462117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545462117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545462117"}]},"ts":"1689545462117"} 2023-07-16 22:11:02,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-16 22:11:02,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 0690061e095fe5735522064dfd4b913a, server=jenkins-hbase4.apache.org,40577,1689545452380 in 206 msec 2023-07-16 22:11:02,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-16 22:11:02,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure f9ef34cae92515bb02ad2df28597ad75, server=jenkins-hbase4.apache.org,44505,1689545452226 in 210 msec 2023-07-16 22:11:02,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, ASSIGN in 374 msec 2023-07-16 22:11:02,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-16 22:11:02,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, ASSIGN in 379 msec 2023-07-16 22:11:02,137 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:11:02,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545462137"}]},"ts":"1689545462137"} 2023-07-16 22:11:02,141 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 22:11:02,145 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:11:02,152 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 22:11:02,161 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,167 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,174 DEBUG [hconnection-0x5708fa93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,179 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:02,189 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 22:11:02,227 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,227 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,227 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,227 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,228 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:11:02,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 686 msec 2023-07-16 22:11:02,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:02,681 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 22:11:02,682 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-16 22:11:02,683 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:02,687 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-16 22:11:02,688 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:02,688 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-16 22:11:02,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:02,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545462704 (current time:1689545462704). 2023-07-16 22:11:02,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:02,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x219e8e23 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:02,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad6de4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:02,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,719 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x219e8e23 to 127.0.0.1:63820 2023-07-16 22:11:02,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:02,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x1f06a5a6 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:02,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@442b787d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:02,732 DEBUG [hconnection-0x27ff0c9c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,733 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,739 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f06a5a6 to 127.0.0.1:63820 2023-07-16 22:11:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 22:11:02,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:02,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:02,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:02,795 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:02,796 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689546062796 2023-07-16 22:11:02,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:02,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 22:11:02,804 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:02,805 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:02,805 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:02,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 23 msec 2023-07-16 22:11:02,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:02,810 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:02,811 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689546062811 2023-07-16 22:11:02,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,865 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 22:11:02,865 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,866 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 22:11:02,866 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 22:11:02,868 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,868 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,873 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:02,873 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:02,873 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:02,874 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,875 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,875 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 22:11:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,876 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,877 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:02,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 22:11:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 22:11:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:02,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:02,884 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,884 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:02,885 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:02,885 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:02,885 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:02,885 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:02,885 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:02,887 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,888 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,888 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:02,889 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,889 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:02,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:02,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:02,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4c0af1[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:02,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:02,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:02,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:02,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4c0af1[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:02,895 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 22:11:02,895 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,898 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:02,898 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:02,898 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:11:02,899 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,899 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:02,898 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:02,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,899 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:02,900 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:02,901 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:02,900 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:02,901 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. started... 2023-07-16 22:11:02,901 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. started... 2023-07-16 22:11:02,902 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:02,902 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:02,902 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:02,906 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:02,906 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0690061e095fe5735522064dfd4b913a: 2023-07-16 22:11:02,906 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9ef34cae92515bb02ad2df28597ad75: 2023-07-16 22:11:02,908 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,908 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:02,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:02,910 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:02,913 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:02,913 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:02,918 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:02,918 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:02,971 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. completed. 2023-07-16 22:11:02,971 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:11:02,983 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:02,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,987 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. completed. 2023-07-16 22:11:02,987 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:02,987 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:02,987 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,988 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,988 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:02,988 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:11:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,990 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 22:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:02,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44505,1689545452226': 2023-07-16 22:11:02,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 22:11:02,999 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 22:11:02,999 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:02,999 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:02,999 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,000 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:03,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,005 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,005 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,007 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,007 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,009 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,010 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,010 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,029 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,029 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,111 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:03,113 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:11:03,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 22:11:03,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689545462799Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689545463030 (+231 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689545463031 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689545463044 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689545463067 (+23 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689545463140 (+73 ms) 2023-07-16 22:11:03,143 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:03,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 336 msec 2023-07-16 22:11:03,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:03,437 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,437 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,444 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,444 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44505] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:03,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:03,453 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 22:11:03,454 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:03,456 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:03,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:03,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545463492 (current time:1689545463492). 2023-07-16 22:11:03,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:03,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x3304827b to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:03,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@733ffb8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:03,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,515 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3304827b to 127.0.0.1:63820 2023-07-16 22:11:03,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:03,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x5f8c9927 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:03,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@488ccff7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:03,536 DEBUG [hconnection-0x44e39ec7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,540 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,550 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f8c9927 to 127.0.0.1:63820 2023-07-16 22:11:03,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:03,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 22:11:03,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:03,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:03,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:03,559 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:03,560 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689546063560 2023-07-16 22:11:03,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:03,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 22:11:03,562 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:03,562 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:03,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:03,564 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:03,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-16 22:11:03,566 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:03,567 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689546063567 2023-07-16 22:11:03,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 22:11:03,587 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 22:11:03,587 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,588 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 22:11:03,588 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 22:11:03,588 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,588 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,590 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,590 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,590 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,590 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,591 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,591 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,591 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,591 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:03,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 22:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 22:11:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:03,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 22:11:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:03,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,595 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:03,595 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:03,595 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,595 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,596 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:03,600 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,601 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,601 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,601 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:03,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:03,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e232a91[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:03,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e232a91[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:03,609 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 22:11:03,609 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,613 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:03,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:03,614 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,614 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:03,614 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:03,614 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. started... 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:03,614 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0690061e095fe5735522064dfd4b913a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 22:11:03,614 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:03,615 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. started... 2023-07-16 22:11:03,615 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f9ef34cae92515bb02ad2df28597ad75 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 22:11:03,617 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:03,617 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,617 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:03,662 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:03,664 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:03,724 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/.tmp/cf/81c04011149a402ca455f4535138e616 2023-07-16 22:11:03,724 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/.tmp/cf/0c1d0073765e451fa49bd5fcd4d7f4ee 2023-07-16 22:11:03,783 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/.tmp/cf/0c1d0073765e451fa49bd5fcd4d7f4ee as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf/0c1d0073765e451fa49bd5fcd4d7f4ee 2023-07-16 22:11:03,783 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/.tmp/cf/81c04011149a402ca455f4535138e616 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf/81c04011149a402ca455f4535138e616 2023-07-16 22:11:03,793 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf/81c04011149a402ca455f4535138e616, entries=2, sequenceid=6, filesize=5.0 K 2023-07-16 22:11:03,793 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf/0c1d0073765e451fa49bd5fcd4d7f4ee, entries=48, sequenceid=6, filesize=8.1 K 2023-07-16 22:11:03,798 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f9ef34cae92515bb02ad2df28597ad75 in 183ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:03,798 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0690061e095fe5735522064dfd4b913a in 184ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:03,798 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 22:11:03,798 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 22:11:03,802 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9ef34cae92515bb02ad2df28597ad75: 2023-07-16 22:11:03,803 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0690061e095fe5735522064dfd4b913a: 2023-07-16 22:11:03,803 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:03,804 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:03,808 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:03,808 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:03,808 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf/0c1d0073765e451fa49bd5fcd4d7f4ee] hfiles 2023-07-16 22:11:03,808 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf/81c04011149a402ca455f4535138e616] hfiles 2023-07-16 22:11:03,808 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf/0c1d0073765e451fa49bd5fcd4d7f4ee for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:03,808 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf/81c04011149a402ca455f4535138e616 for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:03,846 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. completed. 2023-07-16 22:11:03,846 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:11:03,849 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:03,849 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,849 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:03,851 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,852 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. completed. 2023-07-16 22:11:03,852 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:03,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:03,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:03,853 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,854 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,854 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:03,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,854 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,855 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44505,1689545452226': 2023-07-16 22:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 22:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,864 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,867 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:11:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:11:03,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 22:11:03,868 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 22:11:03,868 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:03,868 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:03,868 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,868 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,871 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,876 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,879 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,879 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,882 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,885 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,886 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,899 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,899 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,899 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,899 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,900 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:03,901 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,900 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,901 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 22:11:04,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,031 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689545463561Consolidate snapshot: snaptb0-testExportWithTargetName at 1689545463901 (+340 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689545463901Writing data manifest for snaptb0-testExportWithTargetName at 1689545463909 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689545463931 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689545464028 (+97 ms) 2023-07-16 22:11:04,034 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:04,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 472 msec 2023-07-16 22:11:04,167 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:04,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:04,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:04,170 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170 2023-07-16 22:11:04,171 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40683, tgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170, rawTgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:04,212 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:04,212 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1886517762_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 22:11:04,213 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 22:11:04,232 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 22:11:04,304 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,304 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,305 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,306 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,306 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,306 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,307 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,399 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-4090199941497470742.jar 2023-07-16 22:11:04,400 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,401 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,401 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,402 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,402 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,403 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:04,403 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:04,404 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:04,405 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:04,405 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:04,406 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:04,407 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:04,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:04,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:04,409 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:04,410 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:04,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:04,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:04,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:04,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:04,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:04,416 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:04,416 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:06,284 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:06,290 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 22:11:06,300 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 22:11:06,927 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:06,929 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:07,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:07,585 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:12,419 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:14,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:19,390 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:11:19,394 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:11:19,408 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 22:11:19,408 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:11:19,409 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:11:19,409 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 22:11:19,410 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 22:11:19,410 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 22:11:19,410 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170/.hbase-snapshot/testExportWithTargetName 2023-07-16 22:11:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 22:11:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545464170/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 22:11:19,422 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 22:11:19,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 22:11:19,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,446 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545479444"}]},"ts":"1689545479444"} 2023-07-16 22:11:19,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 22:11:19,448 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 22:11:19,450 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 22:11:19,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, UNASSIGN}] 2023-07-16 22:11:19,455 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, UNASSIGN 2023-07-16 22:11:19,455 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, UNASSIGN 2023-07-16 22:11:19,456 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f9ef34cae92515bb02ad2df28597ad75, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:19,456 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0690061e095fe5735522064dfd4b913a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:19,456 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545479456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545479456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545479456"}]},"ts":"1689545479456"} 2023-07-16 22:11:19,456 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545479456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545479456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545479456"}]},"ts":"1689545479456"} 2023-07-16 22:11:19,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 0690061e095fe5735522064dfd4b913a, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:11:19,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure f9ef34cae92515bb02ad2df28597ad75, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:11:19,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 22:11:19,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:19,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9ef34cae92515bb02ad2df28597ad75, disabling compactions & flushes 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0690061e095fe5735522064dfd4b913a, disabling compactions & flushes 2023-07-16 22:11:19,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:19,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. after waiting 0 ms 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. after waiting 0 ms 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:19,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:19,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:19,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:19,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:19,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:19,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75. 2023-07-16 22:11:19,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a. 2023-07-16 22:11:19,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9ef34cae92515bb02ad2df28597ad75: 2023-07-16 22:11:19,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0690061e095fe5735522064dfd4b913a: 2023-07-16 22:11:19,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:19,638 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f9ef34cae92515bb02ad2df28597ad75, regionState=CLOSED 2023-07-16 22:11:19,638 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545479638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545479638"}]},"ts":"1689545479638"} 2023-07-16 22:11:19,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:19,639 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0690061e095fe5735522064dfd4b913a, regionState=CLOSED 2023-07-16 22:11:19,639 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545479639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545479639"}]},"ts":"1689545479639"} 2023-07-16 22:11:19,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 22:11:19,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure f9ef34cae92515bb02ad2df28597ad75, server=jenkins-hbase4.apache.org,44505,1689545452226 in 181 msec 2023-07-16 22:11:19,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 22:11:19,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 0690061e095fe5735522064dfd4b913a, server=jenkins-hbase4.apache.org,40577,1689545452380 in 184 msec 2023-07-16 22:11:19,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9ef34cae92515bb02ad2df28597ad75, UNASSIGN in 192 msec 2023-07-16 22:11:19,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-16 22:11:19,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0690061e095fe5735522064dfd4b913a, UNASSIGN in 193 msec 2023-07-16 22:11:19,648 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545479648"}]},"ts":"1689545479648"} 2023-07-16 22:11:19,650 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 22:11:19,651 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 22:11:19,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 219 msec 2023-07-16 22:11:19,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 22:11:19,749 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 22:11:19,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 22:11:19,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,764 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 22:11:19,766 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,769 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 22:11:19,772 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:19,772 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:19,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:19,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:19,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:19,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:19,774 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:19,774 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:19,774 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:19,775 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:19,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 22:11:19,775 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:11:19,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 22:11:19,775 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:11:19,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 22:11:19,775 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:11:19,776 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/recovered.edits] 2023-07-16 22:11:19,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 22:11:19,778 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 22:11:19,778 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:11:19,779 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/recovered.edits] 2023-07-16 22:11:19,786 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf/81c04011149a402ca455f4535138e616 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/cf/81c04011149a402ca455f4535138e616 2023-07-16 22:11:19,786 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf/0c1d0073765e451fa49bd5fcd4d7f4ee to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/cf/0c1d0073765e451fa49bd5fcd4d7f4ee 2023-07-16 22:11:19,790 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75/recovered.edits/9.seqid 2023-07-16 22:11:19,790 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a/recovered.edits/9.seqid 2023-07-16 22:11:19,791 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/f9ef34cae92515bb02ad2df28597ad75 2023-07-16 22:11:19,791 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportWithTargetName/0690061e095fe5735522064dfd4b913a 2023-07-16 22:11:19,791 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 22:11:19,793 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,813 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 22:11:19,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 22:11:19,817 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 22:11:19,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545479818"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:19,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545479818"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:19,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:11:19,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f9ef34cae92515bb02ad2df28597ad75, NAME => 'testtb-testExportWithTargetName,,1689545461549.f9ef34cae92515bb02ad2df28597ad75.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0690061e095fe5735522064dfd4b913a, NAME => 'testtb-testExportWithTargetName,1,1689545461549.0690061e095fe5735522064dfd4b913a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:11:19,820 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 22:11:19,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545479820"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:19,822 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 22:11:19,824 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:19,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 69 msec 2023-07-16 22:11:19,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 22:11:19,879 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 22:11:19,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 22:11:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:19,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 22:11:19,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 22:11:19,937 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=757 (was 711) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:44477 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:40693 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:56036 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_74671157_1 at /127.0.0.1:52132 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:55762 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:52148 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_74671157_1 at /127.0.0.1:56020 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=2959 (was 4634) 2023-07-16 22:11:19,937 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-16 22:11:19,960 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=181, AvailableMemoryMB=2958 2023-07-16 22:11:19,960 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-16 22:11:19,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:11:19,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:19,967 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:11:19,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 22:11:19,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:11:19,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:19,971 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:19,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:19,971 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef empty. 2023-07-16 22:11:19,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 empty. 2023-07-16 22:11:19,972 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:19,972 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:19,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 22:11:20,004 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 22:11:20,009 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e797b608bce2a1cfcf940b8d07fce3ef, NAME => 'testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:11:20,010 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => de1db1f6ecafc6b360b68457b81f0a55, NAME => 'testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:11:20,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:20,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e797b608bce2a1cfcf940b8d07fce3ef, disabling compactions & flushes 2023-07-16 22:11:20,041 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. after waiting 0 ms 2023-07-16 22:11:20,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,041 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e797b608bce2a1cfcf940b8d07fce3ef: 2023-07-16 22:11:20,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:20,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing de1db1f6ecafc6b360b68457b81f0a55, disabling compactions & flushes 2023-07-16 22:11:20,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. after waiting 0 ms 2023-07-16 22:11:20,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for de1db1f6ecafc6b360b68457b81f0a55: 2023-07-16 22:11:20,045 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:11:20,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545480046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545480046"}]},"ts":"1689545480046"} 2023-07-16 22:11:20,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545480046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545480046"}]},"ts":"1689545480046"} 2023-07-16 22:11:20,049 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:11:20,050 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:11:20,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545480050"}]},"ts":"1689545480050"} 2023-07-16 22:11:20,052 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 22:11:20,055 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:11:20,057 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:11:20,057 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:11:20,057 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:11:20,057 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:11:20,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, ASSIGN}] 2023-07-16 22:11:20,060 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, ASSIGN 2023-07-16 22:11:20,060 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, ASSIGN 2023-07-16 22:11:20,061 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:11:20,061 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38355,1689545452313; forceNewPlan=false, retain=false 2023-07-16 22:11:20,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:20,211 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:11:20,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e797b608bce2a1cfcf940b8d07fce3ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=de1db1f6ecafc6b360b68457b81f0a55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545480214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545480214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545480214"}]},"ts":"1689545480214"} 2023-07-16 22:11:20,214 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545480214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545480214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545480214"}]},"ts":"1689545480214"} 2023-07-16 22:11:20,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure e797b608bce2a1cfcf940b8d07fce3ef, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:11:20,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure de1db1f6ecafc6b360b68457b81f0a55, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:11:20,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:20,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de1db1f6ecafc6b360b68457b81f0a55, NAME => 'testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:11:20,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. service=AccessControlService 2023-07-16 22:11:20,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:20,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:20,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,383 INFO [StoreOpener-de1db1f6ecafc6b360b68457b81f0a55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,384 DEBUG [StoreOpener-de1db1f6ecafc6b360b68457b81f0a55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf 2023-07-16 22:11:20,385 DEBUG [StoreOpener-de1db1f6ecafc6b360b68457b81f0a55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf 2023-07-16 22:11:20,385 INFO [StoreOpener-de1db1f6ecafc6b360b68457b81f0a55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de1db1f6ecafc6b360b68457b81f0a55 columnFamilyName cf 2023-07-16 22:11:20,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e797b608bce2a1cfcf940b8d07fce3ef, NAME => 'testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:11:20,386 INFO [StoreOpener-de1db1f6ecafc6b360b68457b81f0a55-1] regionserver.HStore(310): Store=de1db1f6ecafc6b360b68457b81f0a55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:20,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. service=AccessControlService 2023-07-16 22:11:20,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:20,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:20,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,390 INFO [StoreOpener-e797b608bce2a1cfcf940b8d07fce3ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:20,395 DEBUG [StoreOpener-e797b608bce2a1cfcf940b8d07fce3ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf 2023-07-16 22:11:20,395 DEBUG [StoreOpener-e797b608bce2a1cfcf940b8d07fce3ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf 2023-07-16 22:11:20,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:20,396 INFO [StoreOpener-e797b608bce2a1cfcf940b8d07fce3ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e797b608bce2a1cfcf940b8d07fce3ef columnFamilyName cf 2023-07-16 22:11:20,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened de1db1f6ecafc6b360b68457b81f0a55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59820598, jitterRate=-0.10860362648963928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:20,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for de1db1f6ecafc6b360b68457b81f0a55: 2023-07-16 22:11:20,397 INFO [StoreOpener-e797b608bce2a1cfcf940b8d07fce3ef-1] regionserver.HStore(310): Store=e797b608bce2a1cfcf940b8d07fce3ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:20,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55., pid=31, masterSystemTime=1689545480372 2023-07-16 22:11:20,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,402 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=de1db1f6ecafc6b360b68457b81f0a55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,403 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545480402"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545480402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545480402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545480402"}]},"ts":"1689545480402"} 2023-07-16 22:11:20,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-16 22:11:20,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure de1db1f6ecafc6b360b68457b81f0a55, server=jenkins-hbase4.apache.org,40577,1689545452380 in 187 msec 2023-07-16 22:11:20,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, ASSIGN in 355 msec 2023-07-16 22:11:20,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:20,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:20,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e797b608bce2a1cfcf940b8d07fce3ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68580518, jitterRate=0.02192935347557068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:20,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e797b608bce2a1cfcf940b8d07fce3ef: 2023-07-16 22:11:20,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef., pid=30, masterSystemTime=1689545480369 2023-07-16 22:11:20,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e797b608bce2a1cfcf940b8d07fce3ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545480431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545480431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545480431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545480431"}]},"ts":"1689545480431"} 2023-07-16 22:11:20,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-16 22:11:20,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure e797b608bce2a1cfcf940b8d07fce3ef, server=jenkins-hbase4.apache.org,38355,1689545452313 in 218 msec 2023-07-16 22:11:20,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-16 22:11:20,442 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:11:20,444 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545480444"}]},"ts":"1689545480444"} 2023-07-16 22:11:20,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, ASSIGN in 381 msec 2023-07-16 22:11:20,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 22:11:20,453 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:11:20,453 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 22:11:20,455 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:11:20,457 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:20,457 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:20,457 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:20,457 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:20,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:20,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:20,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:20,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:20,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 496 msec 2023-07-16 22:11:20,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:20,572 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 22:11:20,572 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 22:11:20,572 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:20,576 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 22:11:20,576 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:20,576 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-16 22:11:20,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:20,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545480580 (current time:1689545480580). 2023-07-16 22:11:20,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:20,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x1f6a342d to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bfc954f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:20,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:20,590 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f6a342d to 127.0.0.1:63820 2023-07-16 22:11:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:20,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x0541ad76 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:20,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bc42aaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:20,599 DEBUG [hconnection-0x45d8875-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:20,601 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:20,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:20,606 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0541ad76 to 127.0.0.1:63820 2023-07-16 22:11:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:11:20,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:20,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:20,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:20,612 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:20,613 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546080613 2023-07-16 22:11:20,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 22:11:20,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:20,614 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:20,614 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:20,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:20,615 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:20,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-16 22:11:20,618 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:20,619 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546080619 2023-07-16 22:11:20,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,635 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 22:11:20,635 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:20,636 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 22:11:20,637 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:11:20,637 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,637 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,639 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:20,639 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:20,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:20,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:20,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:20,639 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:20,639 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:20,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:20,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,640 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,640 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,640 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,640 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,641 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,641 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:20,641 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:20,641 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:20,644 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:20,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,644 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:20,644 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:20,644 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:20,644 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:20,645 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:20,645 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:20,645 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:20,646 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,646 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:20,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:20,652 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,653 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:20,653 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,653 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff881b7[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:20,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:20,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:20,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:20,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff881b7[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:20,657 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:11:20,657 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:20,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,659 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,659 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:20,659 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. started... 2023-07-16 22:11:20,659 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,660 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:20,659 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:20,659 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:20,659 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:20,661 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e797b608bce2a1cfcf940b8d07fce3ef: 2023-07-16 22:11:20,661 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:20,661 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:20,661 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:11:20,661 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,661 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,661 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. started... 2023-07-16 22:11:20,661 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:20,661 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:20,662 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de1db1f6ecafc6b360b68457b81f0a55: 2023-07-16 22:11:20,662 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,663 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:20,663 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:20,680 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. completed. 2023-07-16 22:11:20,680 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:20,680 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:20,680 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:20,680 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,680 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:20,680 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:11:20,683 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,683 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:20,683 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. completed. 2023-07-16 22:11:20,683 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:20,683 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,683 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:20,685 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:20,685 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:20,685 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:20,685 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:20,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:20,685 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:11:20,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:20,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:20,687 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:20,687 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,687 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:20,687 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:20,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:20,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:11:20,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:11:20,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:20,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:20,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:20,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:20,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:11:20,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:11:20,696 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 22:11:20,696 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:20,696 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:20,696 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,696 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:20,698 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,698 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:20,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:20,698 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,698 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,699 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:20,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,698 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:20,699 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,699 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:20,699 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:20,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:20,700 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:20,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,702 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:20,703 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,703 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:20,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:20,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:20,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:20,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:20,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:20,706 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:20,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:20,706 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:20,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:20,708 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:20,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:20,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:20,708 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:20,709 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:20,709 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:20,709 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,709 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,714 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:20,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:20,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:20,716 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:20,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 22:11:20,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,755 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:20,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689545480613Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689545480706 (+93 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689545480707 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689545480712 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689545480723 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689545480754 (+31 ms) 2023-07-16 22:11:20,758 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:20,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 144 msec 2023-07-16 22:11:20,916 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:20,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:20,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:20,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38355] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:20,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:20,936 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 22:11:20,936 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:20,937 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:20,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:20,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545480951 (current time:1689545480951). 2023-07-16 22:11:20,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:20,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x0dcd08f4 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:20,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cc27826, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:20,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:20,964 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:20,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dcd08f4 to 127.0.0.1:63820 2023-07-16 22:11:20,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:20,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x289d7858 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:20,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42fe1dd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:20,975 DEBUG [hconnection-0x62ef2a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:20,977 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:20,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:20,984 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:20,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x289d7858 to 127.0.0.1:63820 2023-07-16 22:11:20,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:20,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:11:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:20,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:20,990 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:20,991 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546080991 2023-07-16 22:11:20,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:20,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 22:11:20,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:20,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:20,994 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:20,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:20,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 22:11:20,996 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:20,997 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546080997 2023-07-16 22:11:21,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 22:11:21,010 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 22:11:21,010 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:21,011 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 22:11:21,011 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:11:21,012 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,012 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,014 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:21,014 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:21,014 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:21,014 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:21,014 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,015 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,015 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,015 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 22:11:21,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:21,016 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:21,016 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:21,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 22:11:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:21,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 22:11:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:21,022 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,022 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:21,022 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,022 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,022 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:21,023 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,023 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:21,023 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,023 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:21,023 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:21,023 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dd40124[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:21,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:21,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:21,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:21,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dd40124[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:21,028 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:11:21,028 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,031 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,031 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:21,031 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:21,031 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:21,031 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. started... 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:21,031 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:11:21,032 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing de1db1f6ecafc6b360b68457b81f0a55 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 22:11:21,032 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:21,033 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:21,033 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:21,033 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. started... 2023-07-16 22:11:21,033 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e797b608bce2a1cfcf940b8d07fce3ef 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 22:11:21,033 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:21,033 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:21,033 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:21,049 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/.tmp/cf/8e5a918be73b4ea3bd8825471cf16f6b 2023-07-16 22:11:21,049 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/.tmp/cf/0f36e83b74eb48ac836c847edcb97506 2023-07-16 22:11:21,060 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/.tmp/cf/0f36e83b74eb48ac836c847edcb97506 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf/0f36e83b74eb48ac836c847edcb97506 2023-07-16 22:11:21,060 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/.tmp/cf/8e5a918be73b4ea3bd8825471cf16f6b as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf/8e5a918be73b4ea3bd8825471cf16f6b 2023-07-16 22:11:21,067 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf/8e5a918be73b4ea3bd8825471cf16f6b, entries=5, sequenceid=6, filesize=5.2 K 2023-07-16 22:11:21,067 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf/0f36e83b74eb48ac836c847edcb97506, entries=45, sequenceid=6, filesize=7.9 K 2023-07-16 22:11:21,069 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for e797b608bce2a1cfcf940b8d07fce3ef in 36ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:21,069 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 22:11:21,070 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for de1db1f6ecafc6b360b68457b81f0a55 in 39ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:21,070 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 22:11:21,070 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e797b608bce2a1cfcf940b8d07fce3ef: 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de1db1f6ecafc6b360b68457b81f0a55: 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf/8e5a918be73b4ea3bd8825471cf16f6b] hfiles 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf/8e5a918be73b4ea3bd8825471cf16f6b for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:21,073 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:21,074 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf/0f36e83b74eb48ac836c847edcb97506] hfiles 2023-07-16 22:11:21,074 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf/0f36e83b74eb48ac836c847edcb97506 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:21,090 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. completed. 2023-07-16 22:11:21,090 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:11:21,090 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. completed. 2023-07-16 22:11:21,090 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:21,090 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:11:21,092 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:21,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:21,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:21,094 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:21,094 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:21,094 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,094 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:21,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:21,095 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:21,096 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,096 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:21,096 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:21,097 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:21,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:21,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:21,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:21,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:11:21,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:11:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:11:21,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:11:21,105 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 22:11:21,105 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:21,105 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:21,105 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 22:11:21,105 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:21,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,108 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:21,108 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:21,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:21,109 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:21,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,111 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,111 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:21,111 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:21,115 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:21,117 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 22:11:21,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:21,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 22:11:21,117 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:21,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:21,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:21,115 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:21,117 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:21,117 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,117 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:21,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:21,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:21,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:21,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:21,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:21,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 22:11:21,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,164 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689545480991Consolidate snapshot: snaptb0-testExportFileSystemState at 1689545481117 (+126 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689545481117Writing data manifest for snaptb0-testExportFileSystemState at 1689545481123 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689545481133 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689545481164 (+31 ms) 2023-07-16 22:11:21,167 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:21,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 175 msec 2023-07-16 22:11:21,294 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:21,297 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297 2023-07-16 22:11:21,297 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40683, tgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297, rawTgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:21,321 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:21,321 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1794402647_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,321 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 22:11:21,334 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:21,363 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,363 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,364 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,364 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,365 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,365 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,365 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,442 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-1292837594847808394.jar 2023-07-16 22:11:21,443 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,443 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,444 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,444 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,445 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,445 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:21,445 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:21,446 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:21,446 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:21,447 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:21,447 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:21,447 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:21,448 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:21,448 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:21,448 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:21,449 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:21,449 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:21,451 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:21,451 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:21,451 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:21,960 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:21,964 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 22:11:21,966 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 22:11:23,908 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:23,908 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:23,916 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:24,462 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:25,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:28,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:31,259 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:33,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:35,252 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:11:35,253 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:11:35,260 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 22:11:35,260 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:11:35,261 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:11:35,261 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 22:11:35,261 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 22:11:35,262 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 22:11:35,262 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 22:11:35,262 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 22:11:35,262 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545481297/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 22:11:35,270 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 22:11:35,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 22:11:35,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 22:11:35,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545495276"}]},"ts":"1689545495276"} 2023-07-16 22:11:35,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 22:11:35,280 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 22:11:35,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, UNASSIGN}] 2023-07-16 22:11:35,283 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, UNASSIGN 2023-07-16 22:11:35,283 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, UNASSIGN 2023-07-16 22:11:35,284 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e797b608bce2a1cfcf940b8d07fce3ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:35,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=de1db1f6ecafc6b360b68457b81f0a55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:35,284 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545495284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545495284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545495284"}]},"ts":"1689545495284"} 2023-07-16 22:11:35,284 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545495284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545495284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545495284"}]},"ts":"1689545495284"} 2023-07-16 22:11:35,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure e797b608bce2a1cfcf940b8d07fce3ef, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:11:35,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure de1db1f6ecafc6b360b68457b81f0a55, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:11:35,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 22:11:35,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:35,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e797b608bce2a1cfcf940b8d07fce3ef, disabling compactions & flushes 2023-07-16 22:11:35,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:35,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:35,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. after waiting 0 ms 2023-07-16 22:11:35,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:35,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:35,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing de1db1f6ecafc6b360b68457b81f0a55, disabling compactions & flushes 2023-07-16 22:11:35,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:35,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:35,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. after waiting 0 ms 2023-07-16 22:11:35,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:35,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:35,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:35,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef. 2023-07-16 22:11:35,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e797b608bce2a1cfcf940b8d07fce3ef: 2023-07-16 22:11:35,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:35,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:35,461 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e797b608bce2a1cfcf940b8d07fce3ef, regionState=CLOSED 2023-07-16 22:11:35,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:35,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55. 2023-07-16 22:11:35,463 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545495461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545495461"}]},"ts":"1689545495461"} 2023-07-16 22:11:35,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for de1db1f6ecafc6b360b68457b81f0a55: 2023-07-16 22:11:35,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:35,472 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=de1db1f6ecafc6b360b68457b81f0a55, regionState=CLOSED 2023-07-16 22:11:35,472 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545495472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545495472"}]},"ts":"1689545495472"} 2023-07-16 22:11:35,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 22:11:35,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure e797b608bce2a1cfcf940b8d07fce3ef, server=jenkins-hbase4.apache.org,38355,1689545452313 in 185 msec 2023-07-16 22:11:35,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e797b608bce2a1cfcf940b8d07fce3ef, UNASSIGN in 193 msec 2023-07-16 22:11:35,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 22:11:35,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure de1db1f6ecafc6b360b68457b81f0a55, server=jenkins-hbase4.apache.org,40577,1689545452380 in 187 msec 2023-07-16 22:11:35,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-16 22:11:35,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=de1db1f6ecafc6b360b68457b81f0a55, UNASSIGN in 197 msec 2023-07-16 22:11:35,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545495482"}]},"ts":"1689545495482"} 2023-07-16 22:11:35,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 22:11:35,485 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 22:11:35,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 216 msec 2023-07-16 22:11:35,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 22:11:35,578 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 22:11:35,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 22:11:35,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 22:11:35,585 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,588 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 22:11:35,591 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:35,592 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:35,593 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,593 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,593 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,593 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:35,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:35,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:35,594 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:35,596 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,596 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:35,596 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,596 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,596 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:35,596 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:35,597 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:35,597 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:35,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 22:11:35,599 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/recovered.edits] 2023-07-16 22:11:35,599 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/recovered.edits] 2023-07-16 22:11:35,609 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf/8e5a918be73b4ea3bd8825471cf16f6b to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/cf/8e5a918be73b4ea3bd8825471cf16f6b 2023-07-16 22:11:35,609 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf/0f36e83b74eb48ac836c847edcb97506 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/cf/0f36e83b74eb48ac836c847edcb97506 2023-07-16 22:11:35,614 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55/recovered.edits/9.seqid 2023-07-16 22:11:35,615 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/de1db1f6ecafc6b360b68457b81f0a55 2023-07-16 22:11:35,620 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef/recovered.edits/9.seqid 2023-07-16 22:11:35,621 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemState/e797b608bce2a1cfcf940b8d07fce3ef 2023-07-16 22:11:35,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 22:11:35,624 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,629 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 22:11:35,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 22:11:35,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 22:11:35,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545495634"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:35,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545495634"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:35,638 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:11:35,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e797b608bce2a1cfcf940b8d07fce3ef, NAME => 'testtb-testExportFileSystemState,,1689545479961.e797b608bce2a1cfcf940b8d07fce3ef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => de1db1f6ecafc6b360b68457b81f0a55, NAME => 'testtb-testExportFileSystemState,1,1689545479961.de1db1f6ecafc6b360b68457b81f0a55.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:11:35,638 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 22:11:35,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545495638"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:35,640 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 22:11:35,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:35,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 63 msec 2023-07-16 22:11:35,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 22:11:35,701 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 22:11:35,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 22:11:35,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:35,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 22:11:35,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 22:11:35,750 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=770 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:46012 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_787547881_1 at /127.0.0.1:51030 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:40259 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:51050 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:33593 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_787547881_1 at /127.0.0.1:35280 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1951 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:35314 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 924) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2486 (was 2958) 2023-07-16 22:11:35,750 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-16 22:11:35,779 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=184, AvailableMemoryMB=2439 2023-07-16 22:11:35,779 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-16 22:11:35,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:11:35,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:11:35,787 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:11:35,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 22:11:35,788 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:11:35,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:35,791 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:35,791 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:35,791 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 empty. 2023-07-16 22:11:35,792 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b empty. 2023-07-16 22:11:35,792 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:35,792 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:35,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 22:11:35,809 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 22:11:35,811 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b635a09719c086ae4ba45a50c468860b, NAME => 'testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:11:35,811 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3af5a8e3d057251e05c3af2e48e11210, NAME => 'testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:11:35,835 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:35,835 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b635a09719c086ae4ba45a50c468860b, disabling compactions & flushes 2023-07-16 22:11:35,835 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:35,835 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:35,835 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. after waiting 0 ms 2023-07-16 22:11:35,835 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:35,835 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:35,835 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b635a09719c086ae4ba45a50c468860b: 2023-07-16 22:11:35,846 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:35,846 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 3af5a8e3d057251e05c3af2e48e11210, disabling compactions & flushes 2023-07-16 22:11:35,846 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:35,846 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:35,846 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. after waiting 0 ms 2023-07-16 22:11:35,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:35,847 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:35,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 3af5a8e3d057251e05c3af2e48e11210: 2023-07-16 22:11:35,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:11:35,854 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545495853"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545495853"}]},"ts":"1689545495853"} 2023-07-16 22:11:35,854 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545495853"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545495853"}]},"ts":"1689545495853"} 2023-07-16 22:11:35,861 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:11:35,863 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:11:35,863 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545495863"}]},"ts":"1689545495863"} 2023-07-16 22:11:35,870 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 22:11:35,875 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:11:35,877 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:11:35,877 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:11:35,877 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:11:35,877 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:11:35,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, ASSIGN}] 2023-07-16 22:11:35,884 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, ASSIGN 2023-07-16 22:11:35,884 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, ASSIGN 2023-07-16 22:11:35,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:11:35,887 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44505,1689545452226; forceNewPlan=false, retain=false 2023-07-16 22:11:35,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:36,036 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:11:36,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b635a09719c086ae4ba45a50c468860b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,040 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3af5a8e3d057251e05c3af2e48e11210, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,040 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545496039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545496039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545496039"}]},"ts":"1689545496039"} 2023-07-16 22:11:36,040 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545496039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545496039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545496039"}]},"ts":"1689545496039"} 2023-07-16 22:11:36,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure b635a09719c086ae4ba45a50c468860b, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:11:36,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 3af5a8e3d057251e05c3af2e48e11210, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:11:36,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:36,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b635a09719c086ae4ba45a50c468860b, NAME => 'testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:11:36,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. service=AccessControlService 2023-07-16 22:11:36,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3af5a8e3d057251e05c3af2e48e11210, NAME => 'testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:11:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. service=AccessControlService 2023-07-16 22:11:36,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:36,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:36,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,208 INFO [StoreOpener-3af5a8e3d057251e05c3af2e48e11210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,211 INFO [StoreOpener-b635a09719c086ae4ba45a50c468860b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,212 DEBUG [StoreOpener-3af5a8e3d057251e05c3af2e48e11210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf 2023-07-16 22:11:36,212 DEBUG [StoreOpener-3af5a8e3d057251e05c3af2e48e11210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf 2023-07-16 22:11:36,212 DEBUG [StoreOpener-b635a09719c086ae4ba45a50c468860b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf 2023-07-16 22:11:36,212 DEBUG [StoreOpener-b635a09719c086ae4ba45a50c468860b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf 2023-07-16 22:11:36,212 INFO [StoreOpener-3af5a8e3d057251e05c3af2e48e11210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3af5a8e3d057251e05c3af2e48e11210 columnFamilyName cf 2023-07-16 22:11:36,213 INFO [StoreOpener-b635a09719c086ae4ba45a50c468860b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b635a09719c086ae4ba45a50c468860b columnFamilyName cf 2023-07-16 22:11:36,213 INFO [StoreOpener-3af5a8e3d057251e05c3af2e48e11210-1] regionserver.HStore(310): Store=3af5a8e3d057251e05c3af2e48e11210/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:36,213 INFO [StoreOpener-b635a09719c086ae4ba45a50c468860b-1] regionserver.HStore(310): Store=b635a09719c086ae4ba45a50c468860b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:36,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:11:36,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b635a09719c086ae4ba45a50c468860b 2023-07-16 22:11:36,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:36,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3af5a8e3d057251e05c3af2e48e11210; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61276485, jitterRate=-0.086909219622612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:36,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3af5a8e3d057251e05c3af2e48e11210: 2023-07-16 22:11:36,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210., pid=46, masterSystemTime=1689545496195 2023-07-16 22:11:36,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:36,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b635a09719c086ae4ba45a50c468860b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67606883, jitterRate=0.007421061396598816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:36,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b635a09719c086ae4ba45a50c468860b: 2023-07-16 22:11:36,230 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3af5a8e3d057251e05c3af2e48e11210, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,231 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545496230"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545496230"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545496230"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545496230"}]},"ts":"1689545496230"} 2023-07-16 22:11:36,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b., pid=45, masterSystemTime=1689545496194 2023-07-16 22:11:36,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,235 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b635a09719c086ae4ba45a50c468860b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,235 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545496234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545496234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545496234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545496234"}]},"ts":"1689545496234"} 2023-07-16 22:11:36,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-16 22:11:36,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 3af5a8e3d057251e05c3af2e48e11210, server=jenkins-hbase4.apache.org,44505,1689545452226 in 191 msec 2023-07-16 22:11:36,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-16 22:11:36,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, ASSIGN in 361 msec 2023-07-16 22:11:36,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure b635a09719c086ae4ba45a50c468860b, server=jenkins-hbase4.apache.org,40577,1689545452380 in 195 msec 2023-07-16 22:11:36,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-16 22:11:36,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, ASSIGN in 363 msec 2023-07-16 22:11:36,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:11:36,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545496243"}]},"ts":"1689545496243"} 2023-07-16 22:11:36,245 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 22:11:36,253 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:11:36,253 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 22:11:36,256 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 22:11:36,257 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:36,258 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:36,258 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:36,258 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:36,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:36,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:36,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:36,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:36,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 478 msec 2023-07-16 22:11:36,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:36,394 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 22:11:36,394 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-16 22:11:36,394 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:36,402 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-16 22:11:36,403 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:36,403 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-16 22:11:36,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:36,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545496410 (current time:1689545496410). 2023-07-16 22:11:36,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:36,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x2014cfb5 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:36,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@125ac784, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:36,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:36,434 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2014cfb5 to 127.0.0.1:63820 2023-07-16 22:11:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x77ca2b71 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:36,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71a53b5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:36,448 DEBUG [hconnection-0x3507a40d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:36,451 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:36,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:36,457 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:36,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77ca2b71 to 127.0.0.1:63820 2023-07-16 22:11:36,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:36,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 22:11:36,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:36,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:36,463 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:36,464 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689546096464 2023-07-16 22:11:36,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:36,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 22:11:36,466 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:36,466 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:36,469 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:36,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:36,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-16 22:11:36,472 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:36,472 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689546096472 2023-07-16 22:11:36,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,484 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 22:11:36,484 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,485 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 22:11:36,485 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 22:11:36,485 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,485 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,488 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,488 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,488 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,488 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,488 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,488 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,489 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:36,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:36,490 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:36,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,490 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:36,490 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:36,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,495 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:36,495 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:36,495 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:36,500 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:36,501 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,501 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,501 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,501 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3692aea2[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:36,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3692aea2[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:36,506 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 22:11:36,506 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:36,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:36,508 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,509 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:36,509 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,509 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,509 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. started... 2023-07-16 22:11:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:11:36,510 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3af5a8e3d057251e05c3af2e48e11210: 2023-07-16 22:11:36,509 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. started... 2023-07-16 22:11:36,509 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:36,510 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:36,509 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:36,511 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:36,511 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b635a09719c086ae4ba45a50c468860b: 2023-07-16 22:11:36,510 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,511 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:36,511 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,511 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:36,511 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:36,512 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:36,518 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:36,518 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,518 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:36,528 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. completed. 2023-07-16 22:11:36,528 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,528 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:36,528 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:36,528 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:11:36,529 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. completed. 2023-07-16 22:11:36,529 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:36,529 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:11:36,530 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:36,530 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,530 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,530 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:36,533 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,533 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:36,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,533 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,533 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:36,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44505,1689545452226': 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:11:36,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 22:11:36,541 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 22:11:36,541 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:36,541 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:36,541 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,541 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:36,543 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,543 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,543 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,543 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,544 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,544 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,545 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,545 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,547 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,547 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,548 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,552 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,552 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,554 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,553 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,554 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,554 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,554 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,554 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,554 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,555 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,555 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,555 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,566 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:36,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:36,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:36,567 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:36,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 22:11:36,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:36,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689545496465Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689545496553 (+88 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689545496554 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689545496557 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689545496571 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689545496602 (+31 ms) 2023-07-16 22:11:36,605 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:36,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 140 msec 2023-07-16 22:11:36,768 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:36,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:36,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:36,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44505] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:36,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:36,782 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 22:11:36,782 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,782 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:36,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:36,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545496794 (current time:1689545496794). 2023-07-16 22:11:36,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:36,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x5d5afda3 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:36,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@374a6777, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:36,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:36,808 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:36,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d5afda3 to 127.0.0.1:63820 2023-07-16 22:11:36,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:36,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x406c5000 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:36,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad10a4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:36,815 DEBUG [hconnection-0x2ec4adb9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:36,817 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:36,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:36,821 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:36,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x406c5000 to 127.0.0.1:63820 2023-07-16 22:11:36,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:36,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 22:11:36,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:36,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:36,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:36,827 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:36,828 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689546096828 2023-07-16 22:11:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:36,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 22:11:36,830 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:36,830 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:36,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:36,831 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:36,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-16 22:11:36,834 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:36,834 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689546096834 2023-07-16 22:11:36,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 22:11:36,845 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 22:11:36,846 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,847 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 22:11:36,847 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 22:11:36,847 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,847 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,849 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,849 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,849 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,849 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,849 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,849 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,850 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 22:11:36,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,851 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:36,851 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:36,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 22:11:36,851 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:36,851 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 22:11:36,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:36,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:36,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 22:11:36,852 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:36,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,852 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:36,852 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:36,854 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:36,854 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:36,854 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:36,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 22:11:36,854 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:36,854 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:36,855 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:36,856 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:36,856 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:36,857 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,857 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:36,860 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,861 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b025475[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:36,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b025475[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:36,865 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 22:11:36,865 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:36,867 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:36,867 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. started... 2023-07-16 22:11:36,867 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:36,867 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. started... 2023-07-16 22:11:36,867 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,867 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:36,867 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b635a09719c086ae4ba45a50c468860b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 22:11:36,867 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3af5a8e3d057251e05c3af2e48e11210 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 22:11:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:11:36,869 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:36,869 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,869 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:36,882 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/.tmp/cf/9e0c518b4a6046eeacd7c05dba56ffff 2023-07-16 22:11:36,882 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/.tmp/cf/5797c45b27f149a28bc1dca25031b8fa 2023-07-16 22:11:36,889 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/.tmp/cf/9e0c518b4a6046eeacd7c05dba56ffff as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf/9e0c518b4a6046eeacd7c05dba56ffff 2023-07-16 22:11:36,889 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/.tmp/cf/5797c45b27f149a28bc1dca25031b8fa as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf/5797c45b27f149a28bc1dca25031b8fa 2023-07-16 22:11:36,895 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf/5797c45b27f149a28bc1dca25031b8fa, entries=47, sequenceid=6, filesize=8 K 2023-07-16 22:11:36,896 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf/9e0c518b4a6046eeacd7c05dba56ffff, entries=3, sequenceid=6, filesize=5.0 K 2023-07-16 22:11:36,896 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b635a09719c086ae4ba45a50c468860b in 29ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:36,896 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 22:11:36,897 INFO [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3af5a8e3d057251e05c3af2e48e11210 in 30ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:36,897 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 22:11:36,897 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b635a09719c086ae4ba45a50c468860b: 2023-07-16 22:11:36,898 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3af5a8e3d057251e05c3af2e48e11210: 2023-07-16 22:11:36,898 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:36,898 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:36,898 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:36,898 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:36,898 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf/5797c45b27f149a28bc1dca25031b8fa] hfiles 2023-07-16 22:11:36,899 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf/9e0c518b4a6046eeacd7c05dba56ffff] hfiles 2023-07-16 22:11:36,899 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf/9e0c518b4a6046eeacd7c05dba56ffff for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:36,899 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf/5797c45b27f149a28bc1dca25031b8fa for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:36,907 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. completed. 2023-07-16 22:11:36,907 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:11:36,907 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. completed. 2023-07-16 22:11:36,907 DEBUG [rs(jenkins-hbase4.apache.org,44505,1689545452226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:11:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:11:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:11:36,910 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,910 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,910 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,910 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:36,910 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,910 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,910 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:36,911 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44505,1689545452226': 2023-07-16 22:11:36,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 22:11:36,921 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 22:11:36,921 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:36,921 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:36,921 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 22:11:36,921 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,925 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,925 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,926 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:36,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:36,928 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:36,928 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,929 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,930 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:36,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:36,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:36,932 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:36,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,935 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:36,937 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 22:11:36,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:36,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 22:11:36,937 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,937 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:11:36,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,937 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:36,938 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:11:36,938 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:11:36,938 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,938 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 22:11:36,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,980 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:36,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689545496828Consolidate snapshot: snaptb0-testConsecutiveExports at 1689545496937 (+109 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689545496937Writing data manifest for snaptb0-testConsecutiveExports at 1689545496941 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689545496954 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689545496979 (+25 ms) 2023-07-16 22:11:36,982 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:36,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 153 msec 2023-07-16 22:11:37,132 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:37,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:37,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:37,133 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133 2023-07-16 22:11:37,134 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:37,157 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:37,157 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@66dac24c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:37,157 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 22:11:37,165 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:37,178 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,179 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,179 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,179 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,180 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,180 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,180 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,250 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-4803264731159468860.jar 2023-07-16 22:11:37,250 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,251 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,251 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,251 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,252 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,252 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:37,253 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:37,253 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:37,253 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:37,254 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:37,254 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:37,254 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:37,255 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:37,255 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:37,255 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:37,256 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:37,256 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:37,257 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:37,257 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:37,257 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:37,257 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:37,258 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:37,258 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:37,663 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:37,665 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 22:11:37,667 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 22:11:40,116 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:40,116 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:40,119 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:40,923 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:41,048 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:45,027 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:47,368 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:50,563 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:51,860 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:11:51,861 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:11:51,869 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 22:11:51,869 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:11:51,870 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:11:51,870 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:11:51,871 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:11:51,871 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:11:51,871 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4be24e49 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:11:51,871 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:11:51,871 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:11:51,873 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:51,905 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:11:51,906 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@d444ceb, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:51,906 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 22:11:51,938 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:51,963 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:51,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:51,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:51,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:51,965 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:51,965 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:51,966 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,037 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-7472590075956149556.jar 2023-07-16 22:11:52,038 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,038 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,039 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,039 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,039 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,039 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:52,040 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:52,040 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:52,041 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:52,041 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:52,041 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:52,042 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:52,042 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:52,043 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:52,043 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:52,044 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:52,045 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:52,045 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:52,046 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:52,046 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:52,046 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:52,047 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:52,047 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:52,889 WARN [DataStreamer for file /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689545460132_0004/libjars/hbase-shaded-protobuf-4.1.4.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-16 22:11:53,407 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:53,410 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 22:11:53,412 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 22:11:56,751 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:56,751 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:56,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:57,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:01,614 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:03,897 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:08,361 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:09,641 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:12:09,641 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:12:09,648 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 22:12:09,648 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:12:09,649 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:12:09,649 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:12:09,654 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:12:09,654 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:12:09,654 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4be24e49 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:12:09,655 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:12:09,655 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/local-export-1689545497133/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:12:09,674 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 22:12:09,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 22:12:09,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:09,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 22:12:09,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545529680"}]},"ts":"1689545529680"} 2023-07-16 22:12:09,682 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 22:12:09,684 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 22:12:09,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, UNASSIGN}] 2023-07-16 22:12:09,686 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, UNASSIGN 2023-07-16 22:12:09,688 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, UNASSIGN 2023-07-16 22:12:09,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b635a09719c086ae4ba45a50c468860b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:09,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3af5a8e3d057251e05c3af2e48e11210, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:09,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545529691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545529691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545529691"}]},"ts":"1689545529691"} 2023-07-16 22:12:09,691 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545529691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545529691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545529691"}]},"ts":"1689545529691"} 2023-07-16 22:12:09,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure b635a09719c086ae4ba45a50c468860b, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:12:09,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 3af5a8e3d057251e05c3af2e48e11210, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:12:09,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 22:12:09,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b635a09719c086ae4ba45a50c468860b 2023-07-16 22:12:09,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b635a09719c086ae4ba45a50c468860b, disabling compactions & flushes 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3af5a8e3d057251e05c3af2e48e11210, disabling compactions & flushes 2023-07-16 22:12:09,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:12:09,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. after waiting 0 ms 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. after waiting 0 ms 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:12:09,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:12:09,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:09,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:09,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210. 2023-07-16 22:12:09,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3af5a8e3d057251e05c3af2e48e11210: 2023-07-16 22:12:09,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:09,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:12:09,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:09,902 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3af5a8e3d057251e05c3af2e48e11210, regionState=CLOSED 2023-07-16 22:12:09,902 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545529902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545529902"}]},"ts":"1689545529902"} 2023-07-16 22:12:09,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b. 2023-07-16 22:12:09,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b635a09719c086ae4ba45a50c468860b: 2023-07-16 22:12:09,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b635a09719c086ae4ba45a50c468860b 2023-07-16 22:12:09,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b635a09719c086ae4ba45a50c468860b, regionState=CLOSED 2023-07-16 22:12:09,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545529913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545529913"}]},"ts":"1689545529913"} 2023-07-16 22:12:09,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-16 22:12:09,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 3af5a8e3d057251e05c3af2e48e11210, server=jenkins-hbase4.apache.org,44505,1689545452226 in 213 msec 2023-07-16 22:12:09,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3af5a8e3d057251e05c3af2e48e11210, UNASSIGN in 230 msec 2023-07-16 22:12:09,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-16 22:12:09,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure b635a09719c086ae4ba45a50c468860b, server=jenkins-hbase4.apache.org,40577,1689545452380 in 222 msec 2023-07-16 22:12:09,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-16 22:12:09,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635a09719c086ae4ba45a50c468860b, UNASSIGN in 233 msec 2023-07-16 22:12:09,927 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545529927"}]},"ts":"1689545529927"} 2023-07-16 22:12:09,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 22:12:09,933 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 22:12:09,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 260 msec 2023-07-16 22:12:09,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 22:12:09,986 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 22:12:09,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 22:12:09,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:09,991 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:09,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 22:12:09,993 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:09,996 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 22:12:10,002 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,003 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,002 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,002 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:10,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:10,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:10,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:10,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-16 22:12:10,005 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:12:10,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:10,005 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:10,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:10,004 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:10,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 22:12:10,011 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:12:10,038 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b 2023-07-16 22:12:10,039 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/recovered.edits] 2023-07-16 22:12:10,041 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/recovered.edits] 2023-07-16 22:12:10,046 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf/9e0c518b4a6046eeacd7c05dba56ffff to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/cf/9e0c518b4a6046eeacd7c05dba56ffff 2023-07-16 22:12:10,052 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210/recovered.edits/9.seqid 2023-07-16 22:12:10,052 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf/5797c45b27f149a28bc1dca25031b8fa to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/cf/5797c45b27f149a28bc1dca25031b8fa 2023-07-16 22:12:10,053 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/3af5a8e3d057251e05c3af2e48e11210 2023-07-16 22:12:10,076 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b/recovered.edits/9.seqid 2023-07-16 22:12:10,077 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testConsecutiveExports/b635a09719c086ae4ba45a50c468860b 2023-07-16 22:12:10,077 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 22:12:10,080 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:10,091 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 22:12:10,104 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 22:12:10,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:10,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 22:12:10,106 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545530106"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:10,106 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545530106"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:10,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 22:12:10,118 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:12:10,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3af5a8e3d057251e05c3af2e48e11210, NAME => 'testtb-testConsecutiveExports,,1689545495781.3af5a8e3d057251e05c3af2e48e11210.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b635a09719c086ae4ba45a50c468860b, NAME => 'testtb-testConsecutiveExports,1,1689545495781.b635a09719c086ae4ba45a50c468860b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:12:10,118 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 22:12:10,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545530118"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:10,129 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 22:12:10,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:10,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 143 msec 2023-07-16 22:12:10,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 22:12:10,309 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 22:12:10,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 22:12:10,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 22:12:10,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 22:12:10,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 22:12:10,390 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=750 (was 770), OpenFileDescriptor=904 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=2205 (was 2439) 2023-07-16 22:12:10,390 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-16 22:12:10,420 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=186, AvailableMemoryMB=2200 2023-07-16 22:12:10,420 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-16 22:12:10,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:12:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:10,427 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:10,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 22:12:10,428 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:10,431 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:10,431 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de 2023-07-16 22:12:10,432 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 empty. 2023-07-16 22:12:10,432 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de empty. 2023-07-16 22:12:10,432 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:10,434 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de 2023-07-16 22:12:10,434 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 22:12:10,486 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:10,495 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1368fb4a5f1acab6bca42f63843b39b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:10,503 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 722d30523e03714160729bc5883561de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:10,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:10,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:10,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 1368fb4a5f1acab6bca42f63843b39b0, disabling compactions & flushes 2023-07-16 22:12:10,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:10,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:10,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. after waiting 0 ms 2023-07-16 22:12:10,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:10,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:10,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 1368fb4a5f1acab6bca42f63843b39b0: 2023-07-16 22:12:10,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:10,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 722d30523e03714160729bc5883561de, disabling compactions & flushes 2023-07-16 22:12:10,634 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:10,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:10,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. after waiting 0 ms 2023-07-16 22:12:10,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:10,635 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:10,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 722d30523e03714160729bc5883561de: 2023-07-16 22:12:10,638 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:10,639 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545530639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545530639"}]},"ts":"1689545530639"} 2023-07-16 22:12:10,639 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545530639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545530639"}]},"ts":"1689545530639"} 2023-07-16 22:12:10,657 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:10,662 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:10,662 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545530662"}]},"ts":"1689545530662"} 2023-07-16 22:12:10,665 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 22:12:10,668 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:10,670 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:10,670 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:10,670 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:10,670 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:10,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, ASSIGN}] 2023-07-16 22:12:10,675 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, ASSIGN 2023-07-16 22:12:10,675 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, ASSIGN 2023-07-16 22:12:10,676 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:12:10,676 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38355,1689545452313; forceNewPlan=false, retain=false 2023-07-16 22:12:10,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:10,826 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:10,829 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=722d30523e03714160729bc5883561de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:10,830 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545530829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545530829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545530829"}]},"ts":"1689545530829"} 2023-07-16 22:12:10,829 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1368fb4a5f1acab6bca42f63843b39b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:10,830 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545530829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545530829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545530829"}]},"ts":"1689545530829"} 2023-07-16 22:12:10,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 722d30523e03714160729bc5883561de, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:12:10,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 1368fb4a5f1acab6bca42f63843b39b0, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:10,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:10,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 722d30523e03714160729bc5883561de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:12:10,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:10,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. service=AccessControlService 2023-07-16 22:12:10,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1368fb4a5f1acab6bca42f63843b39b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:12:10,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:10,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. service=AccessControlService 2023-07-16 22:12:10,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 722d30523e03714160729bc5883561de 2023-07-16 22:12:10,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:10,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 722d30523e03714160729bc5883561de 2023-07-16 22:12:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 722d30523e03714160729bc5883561de 2023-07-16 22:12:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:10,996 INFO [StoreOpener-1368fb4a5f1acab6bca42f63843b39b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:10,996 INFO [StoreOpener-722d30523e03714160729bc5883561de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 722d30523e03714160729bc5883561de 2023-07-16 22:12:10,998 DEBUG [StoreOpener-722d30523e03714160729bc5883561de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf 2023-07-16 22:12:10,998 DEBUG [StoreOpener-1368fb4a5f1acab6bca42f63843b39b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf 2023-07-16 22:12:10,998 DEBUG [StoreOpener-1368fb4a5f1acab6bca42f63843b39b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf 2023-07-16 22:12:10,998 DEBUG [StoreOpener-722d30523e03714160729bc5883561de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf 2023-07-16 22:12:11,000 INFO [StoreOpener-1368fb4a5f1acab6bca42f63843b39b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1368fb4a5f1acab6bca42f63843b39b0 columnFamilyName cf 2023-07-16 22:12:11,000 INFO [StoreOpener-722d30523e03714160729bc5883561de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 722d30523e03714160729bc5883561de columnFamilyName cf 2023-07-16 22:12:11,003 INFO [StoreOpener-722d30523e03714160729bc5883561de-1] regionserver.HStore(310): Store=722d30523e03714160729bc5883561de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:11,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de 2023-07-16 22:12:11,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de 2023-07-16 22:12:11,004 INFO [StoreOpener-1368fb4a5f1acab6bca42f63843b39b0-1] regionserver.HStore(310): Store=1368fb4a5f1acab6bca42f63843b39b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:11,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:11,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:11,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 722d30523e03714160729bc5883561de 2023-07-16 22:12:11,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:11,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:11,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:11,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 722d30523e03714160729bc5883561de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59651559, jitterRate=-0.1111225038766861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:11,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1368fb4a5f1acab6bca42f63843b39b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72631689, jitterRate=0.08229650557041168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:11,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 722d30523e03714160729bc5883561de: 2023-07-16 22:12:11,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1368fb4a5f1acab6bca42f63843b39b0: 2023-07-16 22:12:11,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0., pid=61, masterSystemTime=1689545530987 2023-07-16 22:12:11,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de., pid=60, masterSystemTime=1689545530987 2023-07-16 22:12:11,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:11,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:11,019 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1368fb4a5f1acab6bca42f63843b39b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:11,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:11,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545531019"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545531019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545531019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545531019"}]},"ts":"1689545531019"} 2023-07-16 22:12:11,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=722d30523e03714160729bc5883561de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545531019"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545531019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545531019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545531019"}]},"ts":"1689545531019"} 2023-07-16 22:12:11,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:11,125 INFO [AsyncFSWAL-0-hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData-prefix:jenkins-hbase4.apache.org,35859,1689545450683] wal.AbstractFSWAL(1141): Slow sync cost: 102 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK], DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK]] 2023-07-16 22:12:11,125 INFO [AsyncFSWAL-0-hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData-prefix:jenkins-hbase4.apache.org,35859,1689545450683] wal.AbstractFSWAL(1141): Slow sync cost: 102 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:41337,DS-36c2a005-6c2e-40a7-9b67-ec013dff6918,DISK], DatanodeInfoWithStorage[127.0.0.1:41287,DS-b621aeec-0e08-42f4-8466-d199ca5a6fa6,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-59e6dbad-bf54-42b5-826a-79a3824477ad,DISK]] 2023-07-16 22:12:11,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-16 22:12:11,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-16 22:12:11,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 1368fb4a5f1acab6bca42f63843b39b0, server=jenkins-hbase4.apache.org,38355,1689545452313 in 189 msec 2023-07-16 22:12:11,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 722d30523e03714160729bc5883561de, server=jenkins-hbase4.apache.org,40577,1689545452380 in 191 msec 2023-07-16 22:12:11,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, ASSIGN in 457 msec 2023-07-16 22:12:11,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-16 22:12:11,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, ASSIGN in 457 msec 2023-07-16 22:12:11,130 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:11,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545531130"}]},"ts":"1689545531130"} 2023-07-16 22:12:11,132 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 22:12:11,229 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:11,229 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 22:12:11,231 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 22:12:11,304 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:11,304 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:11,304 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:11,304 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:11,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:11,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:11,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:11,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:11,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 936 msec 2023-07-16 22:12:11,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:11,535 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 22:12:11,535 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-16 22:12:11,535 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:11,538 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-16 22:12:11,538 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:11,538 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-16 22:12:11,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:11,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545531541 (current time:1689545531541). 2023-07-16 22:12:11,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:11,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x06b60f4d to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:11,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0c3337, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:11,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:11,605 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:11,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06b60f4d to 127.0.0.1:63820 2023-07-16 22:12:11,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:11,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x5360a110 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:11,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@651a1056, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:11,676 DEBUG [hconnection-0x2bc10249-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:11,677 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:11,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:11,684 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:11,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5360a110 to 127.0.0.1:63820 2023-07-16 22:12:11,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:11,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 22:12:11,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:11,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:11,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:11,689 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:11,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:11,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,690 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689546131690 2023-07-16 22:12:11,691 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:11,691 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:11,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:11,692 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:11,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-16 22:12:11,694 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:11,695 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689546131695 2023-07-16 22:12:11,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,720 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 22:12:11,720 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:11,721 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 22:12:11,721 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 22:12:11,735 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,735 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:11,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:11,773 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,773 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:11,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:11,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:11,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:11,774 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,774 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,774 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,774 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:11,776 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:11,776 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:11,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:11,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:11,791 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:11,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:11,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:11,792 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,812 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,812 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c66c2d0[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c66c2d0[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:11,817 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 22:12:11,817 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:11,836 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:11,836 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:11,836 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,836 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:11,836 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:11,836 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:11,836 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:11,836 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:11,836 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. started... 2023-07-16 22:12:11,836 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. started... 2023-07-16 22:12:11,838 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1368fb4a5f1acab6bca42f63843b39b0: 2023-07-16 22:12:11,838 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 722d30523e03714160729bc5883561de: 2023-07-16 22:12:11,839 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,839 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:11,839 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,839 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:11,839 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:11,839 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:11,847 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. completed. 2023-07-16 22:12:11,847 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:11,847 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. completed. 2023-07-16 22:12:11,847 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:11,847 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:11,847 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:11,905 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:11,906 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:11,906 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:11,943 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,943 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:11,943 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:11,943 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:11,943 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,943 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:11,943 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:11,945 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:11,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 22:12:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:12:11,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 22:12:11,954 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 22:12:11,954 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:11,954 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:11,954 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,954 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:11,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:11,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:11,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:11,994 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:11,996 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,996 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:11,996 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,996 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:11,997 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,997 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:11,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:11,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:11,998 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:11,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,999 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,000 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:12,001 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,001 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,050 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,050 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,051 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,051 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,054 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 22:12:12,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,201 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689545531690Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545532051 (+361 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545532051Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545532059 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545532137 (+78 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689545532200 (+63 ms) 2023-07-16 22:12:12,204 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:12,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 513 msec 2023-07-16 22:12:12,294 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:12,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:12,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:12,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:12,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38355] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:12,314 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,314 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:12,314 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:12,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:12,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545532332 (current time:1689545532332). 2023-07-16 22:12:12,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:12,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x3f1e9ccf to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:12,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9d6918, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:12,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:12,370 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:12,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f1e9ccf to 127.0.0.1:63820 2023-07-16 22:12:12,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:12,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x7782e18e to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:12,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c31f355, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:12,379 DEBUG [hconnection-0x7ca48862-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:12,382 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:12,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:12,389 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:12,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7782e18e to 127.0.0.1:63820 2023-07-16 22:12:12,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:12,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 22:12:12,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:12,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:12,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:12,395 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:12,395 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689546132395 2023-07-16 22:12:12,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:12,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,397 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:12,397 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:12,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:12,398 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:12,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-16 22:12:12,400 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:12,401 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689546132401 2023-07-16 22:12:12,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,423 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 22:12:12,423 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:12,425 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 22:12:12,425 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 22:12:12,426 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,426 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,427 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,427 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,427 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,427 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,428 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,428 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,430 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,430 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 22:12:12,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:12,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:12,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:12,436 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:12,436 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:12,436 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:12,441 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,441 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:12,442 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,442 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:12,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72a8bae0[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:12,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:12,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:12,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:12,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:12,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72a8bae0[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:12,450 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 22:12:12,450 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:12,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,451 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:12,451 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:12,451 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:12,451 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:12,452 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,452 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:12,452 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. started... 2023-07-16 22:12:12,452 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:12,452 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:12,452 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. started... 2023-07-16 22:12:12,452 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 722d30523e03714160729bc5883561de 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 22:12:12,452 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1368fb4a5f1acab6bca42f63843b39b0 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 22:12:12,453 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:12,453 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:12,453 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:12,497 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:12,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:12,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:12,499 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:12,511 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/.tmp/cf/cc94ab41299b4b208c07a71e5c1e3226 2023-07-16 22:12:12,514 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/.tmp/cf/4b6f5c4100a942a59083a8c76d7de37f 2023-07-16 22:12:12,522 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/.tmp/cf/4b6f5c4100a942a59083a8c76d7de37f as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf/4b6f5c4100a942a59083a8c76d7de37f 2023-07-16 22:12:12,524 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/.tmp/cf/cc94ab41299b4b208c07a71e5c1e3226 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf/cc94ab41299b4b208c07a71e5c1e3226 2023-07-16 22:12:12,528 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf/4b6f5c4100a942a59083a8c76d7de37f, entries=4, sequenceid=6, filesize=5.1 K 2023-07-16 22:12:12,528 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1368fb4a5f1acab6bca42f63843b39b0 in 76ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:12,529 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 22:12:12,529 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1368fb4a5f1acab6bca42f63843b39b0: 2023-07-16 22:12:12,529 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,529 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:12,529 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf/4b6f5c4100a942a59083a8c76d7de37f] hfiles 2023-07-16 22:12:12,529 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf/4b6f5c4100a942a59083a8c76d7de37f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,537 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf/cc94ab41299b4b208c07a71e5c1e3226, entries=46, sequenceid=6, filesize=7.9 K 2023-07-16 22:12:12,538 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 722d30523e03714160729bc5883561de in 86ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:12,539 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 722d30523e03714160729bc5883561de: 2023-07-16 22:12:12,539 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,540 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:12,540 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf/cc94ab41299b4b208c07a71e5c1e3226] hfiles 2023-07-16 22:12:12,540 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf/cc94ab41299b4b208c07a71e5c1e3226 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,555 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. completed. 2023-07-16 22:12:12,555 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,562 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:12,562 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:12,564 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:12,564 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:12,565 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:12,565 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:12,568 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. completed. 2023-07-16 22:12:12,568 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,568 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:12,568 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:12,568 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,568 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:12,569 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,573 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,574 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:12,574 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:12,574 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:12,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 22:12:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:12,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:12:12,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 22:12:12,587 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 22:12:12,587 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:12,587 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:12,587 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,587 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:12,592 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:12,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,592 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,593 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,593 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:12,594 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,599 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:12,599 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,603 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,604 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,604 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,607 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,607 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,607 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:12,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:12,608 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,608 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,608 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,608 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:12,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,611 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,611 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:12,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,699 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:12,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:12,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:12,701 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:12,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 22:12:12,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,712 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689545532396Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689545532611 (+215 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689545532611Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689545532621 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689545532640 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689545532711 (+71 ms) 2023-07-16 22:12:12,715 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:12,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 318 msec 2023-07-16 22:12:13,001 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:13,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:13,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:13,030 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:12:13,034 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:12:13,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38355] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 22:12:13,036 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:12:13,041 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:12:13,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 22:12:13,042 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:12:13,044 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:12:13,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44505] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 22:12:13,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:12:13,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:13,049 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:13,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 22:12:13,050 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:13,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:13,053 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,053 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,053 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 empty. 2023-07-16 22:12:13,053 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 empty. 2023-07-16 22:12:13,054 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,054 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,054 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 22:12:13,065 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:13,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => e49c5db3e241c13445521f2a78479c30, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:13,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a275cdde0bca2d3ec7213fbdd3e7ef85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing e49c5db3e241c13445521f2a78479c30, disabling compactions & flushes 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a275cdde0bca2d3ec7213fbdd3e7ef85, disabling compactions & flushes 2023-07-16 22:12:13,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. after waiting 0 ms 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for e49c5db3e241c13445521f2a78479c30: 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. after waiting 0 ms 2023-07-16 22:12:13,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a275cdde0bca2d3ec7213fbdd3e7ef85: 2023-07-16 22:12:13,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:13,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545533082"}]},"ts":"1689545533082"} 2023-07-16 22:12:13,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545533082"}]},"ts":"1689545533082"} 2023-07-16 22:12:13,085 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:13,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:13,086 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545533085"}]},"ts":"1689545533085"} 2023-07-16 22:12:13,087 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 22:12:13,091 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:13,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:13,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:13,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:13,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:13,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, ASSIGN}] 2023-07-16 22:12:13,094 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, ASSIGN 2023-07-16 22:12:13,095 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, ASSIGN 2023-07-16 22:12:13,097 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44505,1689545452226; forceNewPlan=false, retain=false 2023-07-16 22:12:13,097 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38355,1689545452313; forceNewPlan=false, retain=false 2023-07-16 22:12:13,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:13,247 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:13,250 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a275cdde0bca2d3ec7213fbdd3e7ef85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:13,250 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e49c5db3e241c13445521f2a78479c30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:13,250 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545533250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545533250"}]},"ts":"1689545533250"} 2023-07-16 22:12:13,250 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545533250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545533250"}]},"ts":"1689545533250"} 2023-07-16 22:12:13,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure a275cdde0bca2d3ec7213fbdd3e7ef85, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:13,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure e49c5db3e241c13445521f2a78479c30, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:12:13,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:13,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a275cdde0bca2d3ec7213fbdd3e7ef85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 22:12:13,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e49c5db3e241c13445521f2a78479c30, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 22:12:13,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. service=AccessControlService 2023-07-16 22:12:13,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. service=AccessControlService 2023-07-16 22:12:13,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:13,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,411 INFO [StoreOpener-a275cdde0bca2d3ec7213fbdd3e7ef85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,411 INFO [StoreOpener-e49c5db3e241c13445521f2a78479c30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,412 DEBUG [StoreOpener-e49c5db3e241c13445521f2a78479c30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf 2023-07-16 22:12:13,413 DEBUG [StoreOpener-a275cdde0bca2d3ec7213fbdd3e7ef85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf 2023-07-16 22:12:13,413 DEBUG [StoreOpener-a275cdde0bca2d3ec7213fbdd3e7ef85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf 2023-07-16 22:12:13,413 DEBUG [StoreOpener-e49c5db3e241c13445521f2a78479c30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf 2023-07-16 22:12:13,413 INFO [StoreOpener-a275cdde0bca2d3ec7213fbdd3e7ef85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a275cdde0bca2d3ec7213fbdd3e7ef85 columnFamilyName cf 2023-07-16 22:12:13,413 INFO [StoreOpener-e49c5db3e241c13445521f2a78479c30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e49c5db3e241c13445521f2a78479c30 columnFamilyName cf 2023-07-16 22:12:13,414 INFO [StoreOpener-a275cdde0bca2d3ec7213fbdd3e7ef85-1] regionserver.HStore(310): Store=a275cdde0bca2d3ec7213fbdd3e7ef85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:13,414 INFO [StoreOpener-e49c5db3e241c13445521f2a78479c30-1] regionserver.HStore(310): Store=e49c5db3e241c13445521f2a78479c30/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:13,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:13,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a275cdde0bca2d3ec7213fbdd3e7ef85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73451460, jitterRate=0.09451204538345337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:13,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a275cdde0bca2d3ec7213fbdd3e7ef85: 2023-07-16 22:12:13,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85., pid=69, masterSystemTime=1689545533404 2023-07-16 22:12:13,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:13,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e49c5db3e241c13445521f2a78479c30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69756830, jitterRate=0.039457768201828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:13,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e49c5db3e241c13445521f2a78479c30: 2023-07-16 22:12:13,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a275cdde0bca2d3ec7213fbdd3e7ef85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:13,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545533427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545533427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545533427"}]},"ts":"1689545533427"} 2023-07-16 22:12:13,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30., pid=70, masterSystemTime=1689545533405 2023-07-16 22:12:13,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e49c5db3e241c13445521f2a78479c30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:13,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545533432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545533432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545533432"}]},"ts":"1689545533432"} 2023-07-16 22:12:13,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-16 22:12:13,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure a275cdde0bca2d3ec7213fbdd3e7ef85, server=jenkins-hbase4.apache.org,38355,1689545452313 in 177 msec 2023-07-16 22:12:13,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, ASSIGN in 342 msec 2023-07-16 22:12:13,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-16 22:12:13,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure e49c5db3e241c13445521f2a78479c30, server=jenkins-hbase4.apache.org,44505,1689545452226 in 181 msec 2023-07-16 22:12:13,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-16 22:12:13,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, ASSIGN in 346 msec 2023-07-16 22:12:13,442 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:13,442 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545533442"}]},"ts":"1689545533442"} 2023-07-16 22:12:13,443 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 22:12:13,446 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:13,446 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 22:12:13,448 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 22:12:13,450 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,450 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,450 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,450 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 406 msec 2023-07-16 22:12:13,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:13,655 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 22:12:13,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a275cdde0bca2d3ec7213fbdd3e7ef85, e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a275cdde0bca2d3ec7213fbdd3e7ef85, e49c5db3e241c13445521f2a78479c30], force=true 2023-07-16 22:12:13,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a275cdde0bca2d3ec7213fbdd3e7ef85, e49c5db3e241c13445521f2a78479c30], force=true 2023-07-16 22:12:13,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a275cdde0bca2d3ec7213fbdd3e7ef85, e49c5db3e241c13445521f2a78479c30], force=true 2023-07-16 22:12:13,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a275cdde0bca2d3ec7213fbdd3e7ef85, e49c5db3e241c13445521f2a78479c30], force=true 2023-07-16 22:12:13,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:13,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, UNASSIGN}] 2023-07-16 22:12:13,748 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, UNASSIGN 2023-07-16 22:12:13,748 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, UNASSIGN 2023-07-16 22:12:13,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a275cdde0bca2d3ec7213fbdd3e7ef85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:13,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e49c5db3e241c13445521f2a78479c30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:13,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533749"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545533749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545533749"}]},"ts":"1689545533749"} 2023-07-16 22:12:13,750 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545533749"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545533749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545533749"}]},"ts":"1689545533749"} 2023-07-16 22:12:13,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure e49c5db3e241c13445521f2a78479c30, server=jenkins-hbase4.apache.org,44505,1689545452226}] 2023-07-16 22:12:13,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a275cdde0bca2d3ec7213fbdd3e7ef85, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:13,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:13,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:13,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e49c5db3e241c13445521f2a78479c30, disabling compactions & flushes 2023-07-16 22:12:13,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:13,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. after waiting 0 ms 2023-07-16 22:12:13,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:13,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e49c5db3e241c13445521f2a78479c30 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 22:12:13,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a275cdde0bca2d3ec7213fbdd3e7ef85, disabling compactions & flushes 2023-07-16 22:12:13,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. after waiting 0 ms 2023-07-16 22:12:13,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:13,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a275cdde0bca2d3ec7213fbdd3e7ef85 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 22:12:13,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/.tmp/cf/501ea0a4535343eb8607cfd00a5ab9db 2023-07-16 22:12:13,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/.tmp/cf/ca9a903e06df48138560b10d362f35d5 2023-07-16 22:12:13,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/.tmp/cf/501ea0a4535343eb8607cfd00a5ab9db as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf/501ea0a4535343eb8607cfd00a5ab9db 2023-07-16 22:12:13,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf/501ea0a4535343eb8607cfd00a5ab9db, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 22:12:13,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/.tmp/cf/ca9a903e06df48138560b10d362f35d5 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf/ca9a903e06df48138560b10d362f35d5 2023-07-16 22:12:13,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e49c5db3e241c13445521f2a78479c30 in 69ms, sequenceid=5, compaction requested=false 2023-07-16 22:12:13,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 22:12:14,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf/ca9a903e06df48138560b10d362f35d5, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 22:12:14,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a275cdde0bca2d3ec7213fbdd3e7ef85 in 96ms, sequenceid=5, compaction requested=false 2023-07-16 22:12:14,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 22:12:14,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:14,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30. 2023-07-16 22:12:14,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e49c5db3e241c13445521f2a78479c30: 2023-07-16 22:12:14,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:14,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 22:12:14,016 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e49c5db3e241c13445521f2a78479c30, regionState=CLOSED 2023-07-16 22:12:14,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545534015"}]},"ts":"1689545534015"} 2023-07-16 22:12:14,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:14,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85. 2023-07-16 22:12:14,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a275cdde0bca2d3ec7213fbdd3e7ef85: 2023-07-16 22:12:14,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:14,019 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a275cdde0bca2d3ec7213fbdd3e7ef85, regionState=CLOSED 2023-07-16 22:12:14,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545534019"}]},"ts":"1689545534019"} 2023-07-16 22:12:14,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-16 22:12:14,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure e49c5db3e241c13445521f2a78479c30, server=jenkins-hbase4.apache.org,44505,1689545452226 in 266 msec 2023-07-16 22:12:14,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e49c5db3e241c13445521f2a78479c30, UNASSIGN in 274 msec 2023-07-16 22:12:14,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-16 22:12:14,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a275cdde0bca2d3ec7213fbdd3e7ef85, server=jenkins-hbase4.apache.org,38355,1689545452313 in 269 msec 2023-07-16 22:12:14,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:14,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-16 22:12:14,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a275cdde0bca2d3ec7213fbdd3e7ef85, UNASSIGN in 279 msec 2023-07-16 22:12:14,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:14,570 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:14,586 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 22:12:14,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533046.a275cdde0bca2d3ec7213fbdd3e7ef85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:14,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545533046.e49c5db3e241c13445521f2a78479c30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:14,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:14,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, ASSIGN}] 2023-07-16 22:12:14,660 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, ASSIGN 2023-07-16 22:12:14,661 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,38355,1689545452313; forceNewPlan=false, retain=false 2023-07-16 22:12:14,811 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 22:12:14,813 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e0aeb42a907bdf47916f93b0224ab8a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:14,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545534813"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545534813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545534813"}]},"ts":"1689545534813"} 2023-07-16 22:12:14,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e0aeb42a907bdf47916f93b0224ab8a3, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:14,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:14,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:14,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0aeb42a907bdf47916f93b0224ab8a3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:12:14,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. service=AccessControlService 2023-07-16 22:12:14,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:14,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:14,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:14,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:14,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:14,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/.regioninfo 2023-07-16 22:12:15,402 INFO [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:15,404 DEBUG [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf 2023-07-16 22:12:15,404 DEBUG [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf 2023-07-16 22:12:15,404 INFO [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0aeb42a907bdf47916f93b0224ab8a3 columnFamilyName cf 2023-07-16 22:12:15,440 DEBUG [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] regionserver.HStore(539): loaded hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/501ea0a4535343eb8607cfd00a5ab9db.e49c5db3e241c13445521f2a78479c30->hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf/501ea0a4535343eb8607cfd00a5ab9db-top 2023-07-16 22:12:15,447 DEBUG [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] regionserver.HStore(539): loaded hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/ca9a903e06df48138560b10d362f35d5.a275cdde0bca2d3ec7213fbdd3e7ef85->hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf/ca9a903e06df48138560b10d362f35d5-top 2023-07-16 22:12:15,447 INFO [StoreOpener-e0aeb42a907bdf47916f93b0224ab8a3-1] regionserver.HStore(310): Store=e0aeb42a907bdf47916f93b0224ab8a3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:15,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:15,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:15,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:15,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0aeb42a907bdf47916f93b0224ab8a3; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65159398, jitterRate=-0.029049307107925415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:15,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0aeb42a907bdf47916f93b0224ab8a3: 2023-07-16 22:12:15,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3., pid=77, masterSystemTime=1689545534967 2023-07-16 22:12:15,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.,because compaction is disabled. 2023-07-16 22:12:15,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:15,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:15,463 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e0aeb42a907bdf47916f93b0224ab8a3, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,463 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545535463"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545535463"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545535463"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545535463"}]},"ts":"1689545535463"} 2023-07-16 22:12:15,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 22:12:15,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e0aeb42a907bdf47916f93b0224ab8a3, server=jenkins-hbase4.apache.org,38355,1689545452313 in 650 msec 2023-07-16 22:12:15,473 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:15,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 22:12:15,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, ASSIGN in 814 msec 2023-07-16 22:12:15,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a275cdde0bca2d3ec7213fbdd3e7ef85, e49c5db3e241c13445521f2a78479c30], force=true in 1.7680 sec 2023-07-16 22:12:15,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:15,827 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 22:12:15,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 22:12:15,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545535828 (current time:1689545535828). 2023-07-16 22:12:15,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:15,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x550ceb42 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:15,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2afbe281, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:15,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:15,842 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:15,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x550ceb42 to 127.0.0.1:63820 2023-07-16 22:12:15,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:15,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x00e10cd4 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:15,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3285a171, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:15,858 DEBUG [hconnection-0x479fa24a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:15,861 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:15,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:15,868 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:15,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00e10cd4 to 127.0.0.1:63820 2023-07-16 22:12:15,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:15,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 22:12:15,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:15,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 22:12:15,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 22:12:15,874 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 22:12:15,875 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689546135875 2023-07-16 22:12:15,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 22:12:15,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,876 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:15,880 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:15,880 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 22:12:15,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 22:12:15,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-16 22:12:15,883 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 22:12:15,883 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689546135883 2023-07-16 22:12:15,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,893 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 22:12:15,893 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:15,896 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 22:12:15,896 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 22:12:15,896 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,896 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,898 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:15,898 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:15,898 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:15,898 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:15,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:15,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,898 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,898 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 22:12:15,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 22:12:15,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 22:12:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:15,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,904 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 22:12:15,904 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:15,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,904 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 22:12:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 22:12:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 22:12:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 22:12:15,906 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 22:12:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 22:12:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 22:12:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 22:12:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 22:12:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 22:12:15,909 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,909 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:15,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 22:12:15,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51ecfda9[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:15,913 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 22:12:15,913 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,914 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 22:12:15,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,914 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 22:12:15,914 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 22:12:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:15,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 22:12:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 22:12:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:15,915 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:15,915 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. started... 2023-07-16 22:12:15,917 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0aeb42a907bdf47916f93b0224ab8a3: 2023-07-16 22:12:15,917 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,917 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:15,918 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/501ea0a4535343eb8607cfd00a5ab9db.e49c5db3e241c13445521f2a78479c30->hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf/501ea0a4535343eb8607cfd00a5ab9db-top, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/ca9a903e06df48138560b10d362f35d5.a275cdde0bca2d3ec7213fbdd3e7ef85->hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf/ca9a903e06df48138560b10d362f35d5-top] hfiles 2023-07-16 22:12:15,918 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/501ea0a4535343eb8607cfd00a5ab9db.e49c5db3e241c13445521f2a78479c30 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,918 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 22:12:15,918 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 22:12:15,918 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:15,918 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/ca9a903e06df48138560b10d362f35d5.a275cdde0bca2d3ec7213fbdd3e7ef85 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,918 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:15,918 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 22:12:15,919 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 22:12:15,941 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. completed. 2023-07-16 22:12:15,941 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 22:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:15,950 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,954 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 22:12:15,954 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:15,955 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 22:12:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:15,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 22:12:15,956 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 22:12:15,956 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:15,956 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:15,956 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,956 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:15,957 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:15,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,957 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:15,958 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:15,958 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:15,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:15,959 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:15,959 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:15,961 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,961 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,962 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,962 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,962 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:15,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:15,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:15,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:15,965 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:15,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:15,965 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:15,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,966 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:15,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:15,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:15,980 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:15,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 22:12:15,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:15,982 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:16,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,041 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 22:12:16,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,042 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689545535875Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545535966 (+91 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545535966Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545535970 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545535995 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689545536041 (+46 ms) 2023-07-16 22:12:16,045 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 22:12:16,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 166 msec 2023-07-16 22:12:16,182 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:16,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 22:12:16,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:16,183 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183 2023-07-16 22:12:16,184 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40683, tgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183, rawTgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:12:16,215 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:12:16,216 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_864365445_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,216 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 22:12:16,226 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,302 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,303 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,303 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,304 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,304 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,305 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,305 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,403 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-2435787275821011393.jar 2023-07-16 22:12:16,403 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,405 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,405 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,406 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:16,406 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:12:16,407 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:12:16,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:12:16,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:12:16,409 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:12:16,409 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:12:16,410 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:12:16,410 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:12:16,411 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:12:16,411 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:12:16,413 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:16,413 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:16,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:16,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:16,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:16,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:16,416 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:17,818 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:12:17,824 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 22:12:17,826 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 22:12:18,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:18,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:18,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:20,480 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:24,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:26,848 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:33,215 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:12:33,219 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:12:33,229 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,229 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:12:33,229 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:12:33,230 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,230 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 22:12:33,230 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 22:12:33,230 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,231 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 22:12:33,231 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545536183/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 22:12:33,240 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 22:12:33,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545553244"}]},"ts":"1689545553244"} 2023-07-16 22:12:33,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 22:12:33,248 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 22:12:33,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, UNASSIGN}] 2023-07-16 22:12:33,251 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, UNASSIGN 2023-07-16 22:12:33,251 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e0aeb42a907bdf47916f93b0224ab8a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:33,252 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545553251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545553251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545553251"}]},"ts":"1689545553251"} 2023-07-16 22:12:33,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e0aeb42a907bdf47916f93b0224ab8a3, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:33,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 22:12:33,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0aeb42a907bdf47916f93b0224ab8a3, disabling compactions & flushes 2023-07-16 22:12:33,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. after waiting 0 ms 2023-07-16 22:12:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:33,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 22:12:33,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:33,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3. 2023-07-16 22:12:33,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0aeb42a907bdf47916f93b0224ab8a3: 2023-07-16 22:12:33,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:33,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e0aeb42a907bdf47916f93b0224ab8a3, regionState=CLOSED 2023-07-16 22:12:33,417 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545553417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545553417"}]},"ts":"1689545553417"} 2023-07-16 22:12:33,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 22:12:33,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e0aeb42a907bdf47916f93b0224ab8a3, server=jenkins-hbase4.apache.org,38355,1689545452313 in 165 msec 2023-07-16 22:12:33,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 22:12:33,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e0aeb42a907bdf47916f93b0224ab8a3, UNASSIGN in 171 msec 2023-07-16 22:12:33,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545553421"}]},"ts":"1689545553421"} 2023-07-16 22:12:33,423 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 22:12:33,454 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 22:12:33,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 215 msec 2023-07-16 22:12:33,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 22:12:33,546 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 22:12:33,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,551 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,552 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,553 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,555 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,556 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,556 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,556 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:33,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:33,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:33,557 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:33,557 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:33,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:33,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:33,558 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,558 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,558 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,558 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,558 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,559 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,559 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,558 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,559 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/recovered.edits] 2023-07-16 22:12:33,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:33,559 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/recovered.edits] 2023-07-16 22:12:33,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:33,560 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/recovered.edits] 2023-07-16 22:12:33,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:33,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:33,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 22:12:33,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf/501ea0a4535343eb8607cfd00a5ab9db to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/cf/501ea0a4535343eb8607cfd00a5ab9db 2023-07-16 22:12:33,567 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/501ea0a4535343eb8607cfd00a5ab9db.e49c5db3e241c13445521f2a78479c30 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/501ea0a4535343eb8607cfd00a5ab9db.e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:33,567 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf/ca9a903e06df48138560b10d362f35d5 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/cf/ca9a903e06df48138560b10d362f35d5 2023-07-16 22:12:33,572 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/ca9a903e06df48138560b10d362f35d5.a275cdde0bca2d3ec7213fbdd3e7ef85 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/cf/ca9a903e06df48138560b10d362f35d5.a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:33,574 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/recovered.edits/8.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30/recovered.edits/8.seqid 2023-07-16 22:12:33,575 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e49c5db3e241c13445521f2a78479c30 2023-07-16 22:12:33,575 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/recovered.edits/8.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85/recovered.edits/8.seqid 2023-07-16 22:12:33,576 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a275cdde0bca2d3ec7213fbdd3e7ef85 2023-07-16 22:12:33,577 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/recovered.edits/12.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3/recovered.edits/12.seqid 2023-07-16 22:12:33,577 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e0aeb42a907bdf47916f93b0224ab8a3 2023-07-16 22:12:33,577 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 22:12:33,580 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,584 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 22:12:33,587 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 22:12:33,589 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,589 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 22:12:33,589 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545553589"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:33,591 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 22:12:33,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e0aeb42a907bdf47916f93b0224ab8a3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545533047.e0aeb42a907bdf47916f93b0224ab8a3.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 22:12:33,591 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 22:12:33,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545553591"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:33,594 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 22:12:33,597 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:33,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 50 msec 2023-07-16 22:12:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 22:12:33,663 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 22:12:33,664 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 22:12:33,669 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545553669"}]},"ts":"1689545553669"} 2023-07-16 22:12:33,671 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 22:12:33,673 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 22:12:33,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, UNASSIGN}] 2023-07-16 22:12:33,676 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, UNASSIGN 2023-07-16 22:12:33,676 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, UNASSIGN 2023-07-16 22:12:33,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1368fb4a5f1acab6bca42f63843b39b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:33,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=722d30523e03714160729bc5883561de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:33,677 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545553676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545553676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545553676"}]},"ts":"1689545553676"} 2023-07-16 22:12:33,677 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545553676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545553676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545553676"}]},"ts":"1689545553676"} 2023-07-16 22:12:33,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 722d30523e03714160729bc5883561de, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:12:33,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 1368fb4a5f1acab6bca42f63843b39b0, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:33,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 22:12:33,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1368fb4a5f1acab6bca42f63843b39b0, disabling compactions & flushes 2023-07-16 22:12:33,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. after waiting 0 ms 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:33,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 722d30523e03714160729bc5883561de 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 722d30523e03714160729bc5883561de, disabling compactions & flushes 2023-07-16 22:12:33,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. after waiting 0 ms 2023-07-16 22:12:33,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:33,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:33,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:33,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0. 2023-07-16 22:12:33,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1368fb4a5f1acab6bca42f63843b39b0: 2023-07-16 22:12:33,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:33,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:33,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de. 2023-07-16 22:12:33,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 722d30523e03714160729bc5883561de: 2023-07-16 22:12:33,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:33,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1368fb4a5f1acab6bca42f63843b39b0, regionState=CLOSED 2023-07-16 22:12:33,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 722d30523e03714160729bc5883561de 2023-07-16 22:12:33,852 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545553852"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545553852"}]},"ts":"1689545553852"} 2023-07-16 22:12:33,854 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=722d30523e03714160729bc5883561de, regionState=CLOSED 2023-07-16 22:12:33,854 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545553854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545553854"}]},"ts":"1689545553854"} 2023-07-16 22:12:33,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-16 22:12:33,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-16 22:12:33,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 1368fb4a5f1acab6bca42f63843b39b0, server=jenkins-hbase4.apache.org,38355,1689545452313 in 175 msec 2023-07-16 22:12:33,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 722d30523e03714160729bc5883561de, server=jenkins-hbase4.apache.org,40577,1689545452380 in 180 msec 2023-07-16 22:12:33,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1368fb4a5f1acab6bca42f63843b39b0, UNASSIGN in 187 msec 2023-07-16 22:12:33,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-16 22:12:33,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=722d30523e03714160729bc5883561de, UNASSIGN in 187 msec 2023-07-16 22:12:33,863 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545553863"}]},"ts":"1689545553863"} 2023-07-16 22:12:33,864 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 22:12:33,866 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 22:12:33,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 202 msec 2023-07-16 22:12:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 22:12:33,972 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 22:12:33,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,976 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,977 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,978 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,982 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,982 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,982 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,982 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:33,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:33,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:33,983 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:33,983 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:33,983 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de 2023-07-16 22:12:33,984 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,984 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,984 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,984 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,984 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,984 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,985 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:33,985 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 22:12:33,986 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/recovered.edits] 2023-07-16 22:12:33,986 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/recovered.edits] 2023-07-16 22:12:33,991 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf/4b6f5c4100a942a59083a8c76d7de37f to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/cf/4b6f5c4100a942a59083a8c76d7de37f 2023-07-16 22:12:33,991 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf/cc94ab41299b4b208c07a71e5c1e3226 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/cf/cc94ab41299b4b208c07a71e5c1e3226 2023-07-16 22:12:33,996 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0/recovered.edits/9.seqid 2023-07-16 22:12:33,996 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de/recovered.edits/9.seqid 2023-07-16 22:12:33,997 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1368fb4a5f1acab6bca42f63843b39b0 2023-07-16 22:12:33,997 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/722d30523e03714160729bc5883561de 2023-07-16 22:12:33,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 22:12:34,000 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,003 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 22:12:34,005 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 22:12:34,006 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,006 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 22:12:34,006 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545554006"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,007 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545554006"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,008 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:12:34,008 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1368fb4a5f1acab6bca42f63843b39b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689545530422.1368fb4a5f1acab6bca42f63843b39b0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 722d30523e03714160729bc5883561de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545530422.722d30523e03714160729bc5883561de.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:12:34,008 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 22:12:34,009 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545554008"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,010 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 22:12:34,012 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 39 msec 2023-07-16 22:12:34,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 22:12:34,087 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 22:12:34,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 22:12:34,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 22:12:34,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 22:12:34,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,151 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_462634266_1 at /127.0.0.1:40538 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:34709 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:40562 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:53346 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:34076 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=592 (was 368) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=2135 (was 2200) 2023-07-16 22:12:34,151 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 22:12:34,176 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=592, ProcessCount=183, AvailableMemoryMB=2134 2023-07-16 22:12:34,176 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 22:12:34,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:12:34,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:34,183 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:34,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 22:12:34,184 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:34,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:34,186 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,187 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,187 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee empty. 2023-07-16 22:12:34,187 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 empty. 2023-07-16 22:12:34,188 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,188 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,188 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 22:12:34,200 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:34,202 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d2d555cb6ffad2f4447240d29b268e85, NAME => 'testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:34,202 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c79b249ab3a0b76b05cce570db93adee, NAME => 'testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:34,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:34,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c79b249ab3a0b76b05cce570db93adee, disabling compactions & flushes 2023-07-16 22:12:34,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. after waiting 0 ms 2023-07-16 22:12:34,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c79b249ab3a0b76b05cce570db93adee: 2023-07-16 22:12:34,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:34,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d2d555cb6ffad2f4447240d29b268e85, disabling compactions & flushes 2023-07-16 22:12:34,223 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. after waiting 0 ms 2023-07-16 22:12:34,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,223 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d2d555cb6ffad2f4447240d29b268e85: 2023-07-16 22:12:34,226 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:34,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545554227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545554227"}]},"ts":"1689545554227"} 2023-07-16 22:12:34,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545554227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545554227"}]},"ts":"1689545554227"} 2023-07-16 22:12:34,229 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:34,230 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:34,230 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545554230"}]},"ts":"1689545554230"} 2023-07-16 22:12:34,231 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 22:12:34,236 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:34,237 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:34,238 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:34,238 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:34,238 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:34,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, ASSIGN}] 2023-07-16 22:12:34,241 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, ASSIGN 2023-07-16 22:12:34,241 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, ASSIGN 2023-07-16 22:12:34,241 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:12:34,241 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38355,1689545452313; forceNewPlan=false, retain=false 2023-07-16 22:12:34,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:34,392 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:34,397 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d2d555cb6ffad2f4447240d29b268e85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,397 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545554397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545554397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545554397"}]},"ts":"1689545554397"} 2023-07-16 22:12:34,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure d2d555cb6ffad2f4447240d29b268e85, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:12:34,399 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c79b249ab3a0b76b05cce570db93adee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,399 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545554399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545554399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545554399"}]},"ts":"1689545554399"} 2023-07-16 22:12:34,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure c79b249ab3a0b76b05cce570db93adee, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:34,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:34,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2d555cb6ffad2f4447240d29b268e85, NAME => 'testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:12:34,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. service=AccessControlService 2023-07-16 22:12:34,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:34,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:34,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c79b249ab3a0b76b05cce570db93adee, NAME => 'testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:12:34,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. service=AccessControlService 2023-07-16 22:12:34,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:34,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:34,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,571 INFO [StoreOpener-d2d555cb6ffad2f4447240d29b268e85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,575 INFO [StoreOpener-c79b249ab3a0b76b05cce570db93adee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,576 DEBUG [StoreOpener-d2d555cb6ffad2f4447240d29b268e85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf 2023-07-16 22:12:34,576 DEBUG [StoreOpener-d2d555cb6ffad2f4447240d29b268e85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf 2023-07-16 22:12:34,576 INFO [StoreOpener-d2d555cb6ffad2f4447240d29b268e85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d555cb6ffad2f4447240d29b268e85 columnFamilyName cf 2023-07-16 22:12:34,577 DEBUG [StoreOpener-c79b249ab3a0b76b05cce570db93adee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf 2023-07-16 22:12:34,577 DEBUG [StoreOpener-c79b249ab3a0b76b05cce570db93adee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf 2023-07-16 22:12:34,577 INFO [StoreOpener-c79b249ab3a0b76b05cce570db93adee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c79b249ab3a0b76b05cce570db93adee columnFamilyName cf 2023-07-16 22:12:34,578 INFO [StoreOpener-d2d555cb6ffad2f4447240d29b268e85-1] regionserver.HStore(310): Store=d2d555cb6ffad2f4447240d29b268e85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:34,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,580 INFO [StoreOpener-c79b249ab3a0b76b05cce570db93adee-1] regionserver.HStore(310): Store=c79b249ab3a0b76b05cce570db93adee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:34,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:34,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:34,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:34,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2d555cb6ffad2f4447240d29b268e85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67225572, jitterRate=0.0017390847206115723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:34,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2d555cb6ffad2f4447240d29b268e85: 2023-07-16 22:12:34,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85., pid=93, masterSystemTime=1689545554552 2023-07-16 22:12:34,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,601 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d2d555cb6ffad2f4447240d29b268e85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,601 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545554601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545554601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545554601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545554601"}]},"ts":"1689545554601"} 2023-07-16 22:12:34,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-16 22:12:34,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure d2d555cb6ffad2f4447240d29b268e85, server=jenkins-hbase4.apache.org,40577,1689545452380 in 204 msec 2023-07-16 22:12:34,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, ASSIGN in 367 msec 2023-07-16 22:12:34,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:34,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c79b249ab3a0b76b05cce570db93adee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67471637, jitterRate=0.005405738949775696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:34,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c79b249ab3a0b76b05cce570db93adee: 2023-07-16 22:12:34,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee., pid=94, masterSystemTime=1689545554553 2023-07-16 22:12:34,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,611 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c79b249ab3a0b76b05cce570db93adee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,611 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545554611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545554611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545554611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545554611"}]},"ts":"1689545554611"} 2023-07-16 22:12:34,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-16 22:12:34,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure c79b249ab3a0b76b05cce570db93adee, server=jenkins-hbase4.apache.org,38355,1689545452313 in 211 msec 2023-07-16 22:12:34,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-16 22:12:34,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, ASSIGN in 378 msec 2023-07-16 22:12:34,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:34,621 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545554620"}]},"ts":"1689545554620"} 2023-07-16 22:12:34,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 22:12:34,627 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:34,627 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 22:12:34,629 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:12:34,636 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,636 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,636 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,636 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 461 msec 2023-07-16 22:12:34,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:34,789 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 22:12:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 22:12:34,790 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:34,792 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 22:12:34,793 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:34,793 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-16 22:12:34,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:34,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545554795 (current time:1689545554795). 2023-07-16 22:12:34,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:34,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x6a90fb49 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:34,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23eeb14b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:34,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:34,819 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:34,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a90fb49 to 127.0.0.1:63820 2023-07-16 22:12:34,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:34,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x50cd7838 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:34,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d6a9bdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:34,840 DEBUG [hconnection-0x6bd811d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:34,844 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:34,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:34,853 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:34,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50cd7838 to 127.0.0.1:63820 2023-07-16 22:12:34,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:34,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:12:34,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:34,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:34,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:34,860 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:34,861 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546154861 2023-07-16 22:12:34,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:34,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:34,863 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:34,863 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:34,864 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:34,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:34,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 22:12:34,869 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:34,870 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546154870 2023-07-16 22:12:34,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,899 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 22:12:34,899 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:34,902 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 22:12:34,902 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:12:34,902 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,902 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,907 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:34,907 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:34,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:34,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:34,908 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:34,907 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,908 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,908 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,909 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,909 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:34,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 22:12:34,910 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:34,910 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,911 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:34,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:34,918 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:34,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:34,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:34,920 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:34,920 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:34,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,920 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:34,920 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:34,920 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:34,921 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:34,921 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:34,921 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:34,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:34,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,924 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:34,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:34,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3824aa1d[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:34,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:34,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:34,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3824aa1d[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:34,941 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:12:34,941 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,947 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,947 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:34,947 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,948 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:34,948 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:34,949 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. started... 2023-07-16 22:12:34,949 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:34,959 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d2d555cb6ffad2f4447240d29b268e85: 2023-07-16 22:12:34,960 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. started... 2023-07-16 22:12:34,960 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,960 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:34,961 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c79b249ab3a0b76b05cce570db93adee: 2023-07-16 22:12:34,961 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:34,962 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:34,962 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:34,962 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:34,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:34,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:34,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:34,965 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:34,967 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:34,967 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:34,967 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:34,968 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:34,968 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:34,968 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,003 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. completed. 2023-07-16 22:12:35,003 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:35,005 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,008 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. completed. 2023-07-16 22:12:35,008 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:35,008 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:35,008 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:35,008 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,008 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,008 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,009 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,010 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,010 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,010 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:12:35,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:12:35,017 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 22:12:35,017 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:35,017 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:35,017 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,017 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,020 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,021 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,021 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,022 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,026 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,027 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,027 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,031 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,031 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,031 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,030 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,031 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,033 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 22:12:35,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689545554861Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689545555031 (+170 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689545555033 (+2 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689545555038 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689545555048 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689545555108 (+60 ms) 2023-07-16 22:12:35,113 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:35,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 251 msec 2023-07-16 22:12:35,165 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:35,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:35,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:35,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:35,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38355] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:35,184 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:35,184 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:35,184 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:35,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545555202 (current time:1689545555202). 2023-07-16 22:12:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x6ec43913 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:35,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45b9d3ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:35,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:35,232 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:35,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ec43913 to 127.0.0.1:63820 2023-07-16 22:12:35,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:35,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x43106e51 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:35,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c53cb81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:35,340 DEBUG [hconnection-0x7fc4d06-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:35,341 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:35,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:35,348 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:35,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43106e51 to 127.0.0.1:63820 2023-07-16 22:12:35,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:35,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:12:35,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:35,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:35,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:35,354 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:35,355 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546155355 2023-07-16 22:12:35,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:35,355 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:35,356 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:35,357 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:35,358 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:35,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:35,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 22:12:35,360 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:35,360 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546155360 2023-07-16 22:12:35,457 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:35,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:35,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:35,458 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:35,658 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:35,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:35,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:35,660 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:35,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,782 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 22:12:35,782 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,782 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 22:12:35,782 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:12:35,783 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,783 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,784 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,784 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,785 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,785 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,786 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,786 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 22:12:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 22:12:35,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,788 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,788 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:35,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:35,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 22:12:35,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:35,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,804 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,812 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,813 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,814 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,814 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:35,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@721e9f8b[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:35,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@721e9f8b[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:35,822 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:12:35,822 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:35,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,828 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,828 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:35,828 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:35,828 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,828 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:35,828 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,828 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:35,829 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:35,829 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:35,829 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:35,829 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. started... 2023-07-16 22:12:35,829 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:35,829 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:35,829 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:35,829 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. started... 2023-07-16 22:12:35,829 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c79b249ab3a0b76b05cce570db93adee 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 22:12:35,829 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d2d555cb6ffad2f4447240d29b268e85 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 22:12:35,831 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,832 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,832 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,878 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/.tmp/cf/2ff97c4cb7f5438fb138fbcb929a6df8 2023-07-16 22:12:35,883 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/.tmp/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e 2023-07-16 22:12:35,889 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/.tmp/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e 2023-07-16 22:12:35,893 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/.tmp/cf/2ff97c4cb7f5438fb138fbcb929a6df8 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf/2ff97c4cb7f5438fb138fbcb929a6df8 2023-07-16 22:12:35,900 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e, entries=48, sequenceid=6, filesize=8.1 K 2023-07-16 22:12:35,902 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d2d555cb6ffad2f4447240d29b268e85 in 73ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:35,903 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 22:12:35,903 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d2d555cb6ffad2f4447240d29b268e85: 2023-07-16 22:12:35,904 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,904 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:35,904 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e] hfiles 2023-07-16 22:12:35,904 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf/2ff97c4cb7f5438fb138fbcb929a6df8, entries=2, sequenceid=6, filesize=5.0 K 2023-07-16 22:12:35,907 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c79b249ab3a0b76b05cce570db93adee in 78ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:35,909 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c79b249ab3a0b76b05cce570db93adee: 2023-07-16 22:12:35,909 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,911 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:35,911 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf/2ff97c4cb7f5438fb138fbcb929a6df8] hfiles 2023-07-16 22:12:35,911 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf/2ff97c4cb7f5438fb138fbcb929a6df8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,940 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. completed. 2023-07-16 22:12:35,941 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. completed. 2023-07-16 22:12:35,941 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:35,941 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:35,943 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,943 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,943 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,943 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,945 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,945 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,945 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,945 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:35,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:12:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:12:35,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:12:35,958 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 22:12:35,958 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:35,958 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:35,958 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,958 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:35,960 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:35,960 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,960 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,960 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:35,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:35,961 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,962 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 22:12:35,961 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,963 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,964 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,966 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,967 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,967 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,972 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,972 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,972 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,972 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:35,972 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,972 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,973 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,975 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:35,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,973 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:35,975 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:35,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,975 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,975 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:35,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:35,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 22:12:36,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,031 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689545555355Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689545555973 (+618 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689545555973Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689545555978 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689545555992 (+14 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689545556030 (+38 ms) 2023-07-16 22:12:36,034 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:36,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 678 msec 2023-07-16 22:12:36,462 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:36,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:36,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:36,464 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464 2023-07-16 22:12:36,464 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40683, tgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464, rawTgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:12:36,494 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:12:36,494 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_664941533_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,494 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 22:12:36,501 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,545 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,546 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,547 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,547 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,548 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,548 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,549 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,633 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-5187507577838074905.jar 2023-07-16 22:12:36,633 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,634 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,634 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,634 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,635 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,635 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:36,635 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:12:36,636 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:12:36,636 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:12:36,637 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:12:36,637 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:12:36,638 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:12:36,638 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:12:36,638 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:12:36,639 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:12:36,639 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:12:36,640 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:36,640 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:36,641 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:36,641 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:36,642 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:36,642 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:36,643 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:37,757 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:12:37,759 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 22:12:37,964 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:37,964 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:37,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:38,606 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0006_000001 (auth:SIMPLE) 2023-07-16 22:12:39,020 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:45,335 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0006_000001 (auth:SIMPLE) 2023-07-16 22:12:48,196 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:12:48,199 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:12:48,205 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:48,205 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:12:48,206 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:12:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 22:12:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 22:12:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:48,207 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 22:12:48,207 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545556464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 22:12:48,211 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 22:12:48,215 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545568215"}]},"ts":"1689545568215"} 2023-07-16 22:12:48,217 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 22:12:48,218 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 22:12:48,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, UNASSIGN}] 2023-07-16 22:12:48,222 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, UNASSIGN 2023-07-16 22:12:48,222 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, UNASSIGN 2023-07-16 22:12:48,223 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d2d555cb6ffad2f4447240d29b268e85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:48,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c79b249ab3a0b76b05cce570db93adee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:48,223 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545568223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545568223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545568223"}]},"ts":"1689545568223"} 2023-07-16 22:12:48,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545568223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545568223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545568223"}]},"ts":"1689545568223"} 2023-07-16 22:12:48,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure d2d555cb6ffad2f4447240d29b268e85, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:12:48,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure c79b249ab3a0b76b05cce570db93adee, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:48,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 22:12:48,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:48,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2d555cb6ffad2f4447240d29b268e85, disabling compactions & flushes 2023-07-16 22:12:48,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:48,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:48,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. after waiting 0 ms 2023-07-16 22:12:48,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:48,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:48,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c79b249ab3a0b76b05cce570db93adee, disabling compactions & flushes 2023-07-16 22:12:48,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:48,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:48,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. after waiting 0 ms 2023-07-16 22:12:48,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:48,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:48,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:48,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:48,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85. 2023-07-16 22:12:48,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2d555cb6ffad2f4447240d29b268e85: 2023-07-16 22:12:48,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:48,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee. 2023-07-16 22:12:48,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c79b249ab3a0b76b05cce570db93adee: 2023-07-16 22:12:48,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:48,396 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d2d555cb6ffad2f4447240d29b268e85, regionState=CLOSED 2023-07-16 22:12:48,396 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545568396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545568396"}]},"ts":"1689545568396"} 2023-07-16 22:12:48,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:48,397 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c79b249ab3a0b76b05cce570db93adee, regionState=CLOSED 2023-07-16 22:12:48,397 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545568397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545568397"}]},"ts":"1689545568397"} 2023-07-16 22:12:48,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-16 22:12:48,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure d2d555cb6ffad2f4447240d29b268e85, server=jenkins-hbase4.apache.org,40577,1689545452380 in 174 msec 2023-07-16 22:12:48,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-16 22:12:48,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure c79b249ab3a0b76b05cce570db93adee, server=jenkins-hbase4.apache.org,38355,1689545452313 in 172 msec 2023-07-16 22:12:48,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d2d555cb6ffad2f4447240d29b268e85, UNASSIGN in 181 msec 2023-07-16 22:12:48,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-16 22:12:48,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c79b249ab3a0b76b05cce570db93adee, UNASSIGN in 182 msec 2023-07-16 22:12:48,404 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545568404"}]},"ts":"1689545568404"} 2023-07-16 22:12:48,405 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 22:12:48,408 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 22:12:48,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 196 msec 2023-07-16 22:12:48,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 22:12:48,518 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 22:12:48,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,522 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,523 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,525 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,528 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,528 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,528 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,529 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 22:12:48,529 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,529 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:48,529 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:48,530 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-16 22:12:48,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-16 22:12:48,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-16 22:12:48,530 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:12:48,530 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:48,530 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:12:48,530 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:48,530 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:48,530 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:48,530 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:12:48,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 22:12:48,532 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/recovered.edits] 2023-07-16 22:12:48,532 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/recovered.edits] 2023-07-16 22:12:48,543 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf/2ff97c4cb7f5438fb138fbcb929a6df8 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/cf/2ff97c4cb7f5438fb138fbcb929a6df8 2023-07-16 22:12:48,543 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/cf/3ae4b4dcf46d46d09ec4a2959eaa8c2e 2023-07-16 22:12:48,546 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee/recovered.edits/9.seqid 2023-07-16 22:12:48,546 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85/recovered.edits/9.seqid 2023-07-16 22:12:48,547 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d2d555cb6ffad2f4447240d29b268e85 2023-07-16 22:12:48,547 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/c79b249ab3a0b76b05cce570db93adee 2023-07-16 22:12:48,547 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 22:12:48,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,552 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 22:12:48,554 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 22:12:48,555 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,555 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 22:12:48,555 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545568555"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:48,555 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545568555"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:48,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:12:48,557 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c79b249ab3a0b76b05cce570db93adee, NAME => 'testtb-testEmptyExportFileSystemState,,1689545554178.c79b249ab3a0b76b05cce570db93adee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d2d555cb6ffad2f4447240d29b268e85, NAME => 'testtb-testEmptyExportFileSystemState,1,1689545554178.d2d555cb6ffad2f4447240d29b268e85.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:12:48,557 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 22:12:48,557 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545568557"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:48,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 22:12:48,561 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:48,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 42 msec 2023-07-16 22:12:48,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 22:12:48,633 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 22:12:48,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 22:12:48,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:48,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 22:12:48,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:48,679 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 762), OpenFileDescriptor=909 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=609 (was 592) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1383 (was 2134) 2023-07-16 22:12:48,679 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 22:12:48,706 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=609, ProcessCount=183, AvailableMemoryMB=1383 2023-07-16 22:12:48,706 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 22:12:48,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:12:48,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:48,712 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:48,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 22:12:48,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:48,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:48,716 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:48,716 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:48,716 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c empty. 2023-07-16 22:12:48,717 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d empty. 2023-07-16 22:12:48,717 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:48,717 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:48,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 22:12:48,731 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:48,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 392fa12621b84c8264d40515dcd3f97d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:48,752 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b19af7758d48b1f7772c88e2717e164c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp 2023-07-16 22:12:48,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:48,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b19af7758d48b1f7772c88e2717e164c, disabling compactions & flushes 2023-07-16 22:12:48,778 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:48,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:48,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. after waiting 0 ms 2023-07-16 22:12:48,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:48,778 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:48,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b19af7758d48b1f7772c88e2717e164c: 2023-07-16 22:12:48,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:48,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 392fa12621b84c8264d40515dcd3f97d, disabling compactions & flushes 2023-07-16 22:12:48,779 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:48,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:48,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. after waiting 0 ms 2023-07-16 22:12:48,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:48,779 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:48,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 392fa12621b84c8264d40515dcd3f97d: 2023-07-16 22:12:48,782 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:48,783 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545568783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545568783"}]},"ts":"1689545568783"} 2023-07-16 22:12:48,783 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545568783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545568783"}]},"ts":"1689545568783"} 2023-07-16 22:12:48,785 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:48,786 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:48,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545568787"}]},"ts":"1689545568787"} 2023-07-16 22:12:48,788 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 22:12:48,791 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:48,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:48,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:48,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:48,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:48,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, ASSIGN}] 2023-07-16 22:12:48,795 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, ASSIGN 2023-07-16 22:12:48,795 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, ASSIGN 2023-07-16 22:12:48,796 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38355,1689545452313; forceNewPlan=false, retain=false 2023-07-16 22:12:48,796 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40577,1689545452380; forceNewPlan=false, retain=false 2023-07-16 22:12:48,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:48,946 INFO [jenkins-hbase4:35859] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:48,950 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=392fa12621b84c8264d40515dcd3f97d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:48,950 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b19af7758d48b1f7772c88e2717e164c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:48,950 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545568950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545568950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545568950"}]},"ts":"1689545568950"} 2023-07-16 22:12:48,950 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545568950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545568950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545568950"}]},"ts":"1689545568950"} 2023-07-16 22:12:48,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 392fa12621b84c8264d40515dcd3f97d, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:12:48,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure b19af7758d48b1f7772c88e2717e164c, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:12:49,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:49,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:49,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 392fa12621b84c8264d40515dcd3f97d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:12:49,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. service=AccessControlService 2023-07-16 22:12:49,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:49,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:49,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b19af7758d48b1f7772c88e2717e164c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:12:49,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. service=AccessControlService 2023-07-16 22:12:49,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,128 INFO [StoreOpener-392fa12621b84c8264d40515dcd3f97d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,129 INFO [StoreOpener-b19af7758d48b1f7772c88e2717e164c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,139 DEBUG [StoreOpener-392fa12621b84c8264d40515dcd3f97d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf 2023-07-16 22:12:49,139 DEBUG [StoreOpener-392fa12621b84c8264d40515dcd3f97d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf 2023-07-16 22:12:49,139 DEBUG [StoreOpener-b19af7758d48b1f7772c88e2717e164c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf 2023-07-16 22:12:49,139 DEBUG [StoreOpener-b19af7758d48b1f7772c88e2717e164c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf 2023-07-16 22:12:49,140 INFO [StoreOpener-392fa12621b84c8264d40515dcd3f97d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 392fa12621b84c8264d40515dcd3f97d columnFamilyName cf 2023-07-16 22:12:49,140 INFO [StoreOpener-b19af7758d48b1f7772c88e2717e164c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b19af7758d48b1f7772c88e2717e164c columnFamilyName cf 2023-07-16 22:12:49,141 INFO [StoreOpener-b19af7758d48b1f7772c88e2717e164c-1] regionserver.HStore(310): Store=b19af7758d48b1f7772c88e2717e164c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:49,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,142 INFO [StoreOpener-392fa12621b84c8264d40515dcd3f97d-1] regionserver.HStore(310): Store=392fa12621b84c8264d40515dcd3f97d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:49,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:12:49,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:12:49,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:49,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:49,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b19af7758d48b1f7772c88e2717e164c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68812211, jitterRate=0.025381848216056824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:49,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b19af7758d48b1f7772c88e2717e164c: 2023-07-16 22:12:49,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 392fa12621b84c8264d40515dcd3f97d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59444638, jitterRate=-0.11420586705207825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:49,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 392fa12621b84c8264d40515dcd3f97d: 2023-07-16 22:12:49,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c., pid=109, masterSystemTime=1689545569115 2023-07-16 22:12:49,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d., pid=108, masterSystemTime=1689545569114 2023-07-16 22:12:49,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:49,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:49,175 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b19af7758d48b1f7772c88e2717e164c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:49,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:49,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545569175"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545569175"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545569175"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545569175"}]},"ts":"1689545569175"} 2023-07-16 22:12:49,176 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=392fa12621b84c8264d40515dcd3f97d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,177 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545569176"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545569176"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545569176"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545569176"}]},"ts":"1689545569176"} 2023-07-16 22:12:49,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-16 22:12:49,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure b19af7758d48b1f7772c88e2717e164c, server=jenkins-hbase4.apache.org,38355,1689545452313 in 216 msec 2023-07-16 22:12:49,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-16 22:12:49,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 392fa12621b84c8264d40515dcd3f97d, server=jenkins-hbase4.apache.org,40577,1689545452380 in 217 msec 2023-07-16 22:12:49,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, ASSIGN in 390 msec 2023-07-16 22:12:49,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-16 22:12:49,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, ASSIGN in 391 msec 2023-07-16 22:12:49,186 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:49,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545569186"}]},"ts":"1689545569186"} 2023-07-16 22:12:49,188 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 22:12:49,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:49,192 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 22:12:49,195 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 22:12:49,197 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,197 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,197 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,198 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,198 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:49,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 490 msec 2023-07-16 22:12:49,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:49,320 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 22:12:49,320 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-16 22:12:49,321 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:49,323 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-16 22:12:49,323 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:49,324 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-16 22:12:49,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545569326 (current time:1689545569326). 2023-07-16 22:12:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x6903481f to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:49,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b0d1828, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:49,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:49,335 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 22:12:49,342 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:49,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6903481f to 127.0.0.1:63820 2023-07-16 22:12:49,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:49,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x4d6ec214 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:49,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5e3816, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:49,350 DEBUG [hconnection-0x1d31abad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:49,353 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:49,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:49,360 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:49,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d6ec214 to 127.0.0.1:63820 2023-07-16 22:12:49,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:49,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 22:12:49,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:49,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:49,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:49,366 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:49,367 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689546169367 2023-07-16 22:12:49,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:49,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,369 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:49,369 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:49,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:49,370 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:49,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-16 22:12:49,373 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:49,374 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689546169374 2023-07-16 22:12:49,469 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:49,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:49,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:49,470 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:49,670 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:49,672 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:49,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,801 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 22:12:49,801 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:49,801 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 22:12:49,801 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 22:12:49,804 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,804 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,805 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:49,805 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:49,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:49,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:49,805 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:49,805 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:49,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:49,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:49,806 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,806 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,810 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,810 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:49,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:49,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,814 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:49,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,814 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:49,814 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:49,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,817 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:49,817 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:49,817 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:49,817 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:49,817 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:49,818 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:49,818 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:49,818 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:49,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,825 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:49,826 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:49,826 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45d65492[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:49,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:49,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45d65492[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:49,830 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 22:12:49,831 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:49,832 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:49,833 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,833 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:49,834 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:49,834 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:49,834 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:49,842 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:49,844 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:49,844 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:49,844 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. started... 2023-07-16 22:12:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:49,844 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. started... 2023-07-16 22:12:49,846 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 392fa12621b84c8264d40515dcd3f97d: 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b19af7758d48b1f7772c88e2717e164c: 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:49,847 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:49,885 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. completed. 2023-07-16 22:12:49,886 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:49,886 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. completed. 2023-07-16 22:12:49,886 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:49,889 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:49,889 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:49,889 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:49,892 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,892 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 22:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:49,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 22:12:49,909 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 22:12:49,909 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:49,909 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:49,910 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,910 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,912 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,913 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:49,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:49,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,914 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:49,914 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:49,917 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,917 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,918 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,921 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:49,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:49,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:49,921 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:49,922 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:49,922 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:49,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,922 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:49,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:49,921 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,921 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:49,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:49,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:49,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:49,924 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:49,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:49,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:49,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:49,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:49,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:49,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:49,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:49,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:49,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:49,974 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 22:12:49,996 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 22:12:49,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,997 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689545569367Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545569924 (+557 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545569925 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545569939 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545569966 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689545569996 (+30 ms) 2023-07-16 22:12:50,000 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 631 msec 2023-07-16 22:12:50,474 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:50,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:50,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38355] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:50,496 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,496 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:50,499 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:50,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:50,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545570520 (current time:1689545570520). 2023-07-16 22:12:50,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:50,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x4d671164 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:50,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d1bb7a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:50,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:50,548 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d671164 to 127.0.0.1:63820 2023-07-16 22:12:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(139): Connect 0x4e176703 to 127.0.0.1:63820 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:50,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b8eb394, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:50,582 DEBUG [hconnection-0x3ba895c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:50,590 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:50,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:50,599 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:50,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e176703 to 127.0.0.1:63820 2023-07-16 22:12:50,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:50,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 22:12:50,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:50,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:50,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:50,608 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:50,609 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689546170609 2023-07-16 22:12:50,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:50,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,612 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:50,612 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:50,616 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:50,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 13 msec 2023-07-16 22:12:50,618 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,619 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689546170619 2023-07-16 22:12:50,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,637 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 22:12:50,637 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,638 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 22:12:50,639 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 22:12:50,639 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,639 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,641 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,641 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,641 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:50,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,643 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:50,643 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,647 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,647 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,647 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,648 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,648 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:50,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,658 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:50,658 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:50,658 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:50,658 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:50,658 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,658 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:50,659 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:50,659 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44505,1689545452226' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:50,660 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:50,660 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:50,660 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:50,663 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,664 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40577,1689545452380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:50,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e1f834[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38355,1689545452313' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:50,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e1f834[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:50,677 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 22:12:50,677 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,684 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:50,684 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,684 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,685 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:50,685 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:50,685 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44505,1689545452226' in zk 2023-07-16 22:12:50,687 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,687 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:50,688 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:50,688 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. started... 2023-07-16 22:12:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:50,689 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:50,689 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 392fa12621b84c8264d40515dcd3f97d 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 22:12:50,689 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. started... 2023-07-16 22:12:50,689 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:50,689 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,689 DEBUG [member: 'jenkins-hbase4.apache.org,44505,1689545452226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:50,705 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b19af7758d48b1f7772c88e2717e164c 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 22:12:50,712 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:50,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:50,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:50,713 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:50,761 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/.tmp/cf/e3a42b618b21473f99ace9bfebdb6158 2023-07-16 22:12:50,769 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/.tmp/cf/e3a42b618b21473f99ace9bfebdb6158 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf/e3a42b618b21473f99ace9bfebdb6158 2023-07-16 22:12:50,773 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/.tmp/cf/50ddd5ed1f8646d4ac0394409d01a73a 2023-07-16 22:12:50,779 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf/e3a42b618b21473f99ace9bfebdb6158, entries=5, sequenceid=6, filesize=5.2 K 2023-07-16 22:12:50,780 INFO [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 392fa12621b84c8264d40515dcd3f97d in 91ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:50,782 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 392fa12621b84c8264d40515dcd3f97d: 2023-07-16 22:12:50,782 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,782 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:50,782 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf/e3a42b618b21473f99ace9bfebdb6158] hfiles 2023-07-16 22:12:50,782 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf/e3a42b618b21473f99ace9bfebdb6158 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,784 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/.tmp/cf/50ddd5ed1f8646d4ac0394409d01a73a as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf/50ddd5ed1f8646d4ac0394409d01a73a 2023-07-16 22:12:50,789 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf/50ddd5ed1f8646d4ac0394409d01a73a, entries=45, sequenceid=6, filesize=7.9 K 2023-07-16 22:12:50,791 INFO [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b19af7758d48b1f7772c88e2717e164c in 86ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:50,791 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b19af7758d48b1f7772c88e2717e164c: 2023-07-16 22:12:50,791 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,791 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:50,791 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf/50ddd5ed1f8646d4ac0394409d01a73a] hfiles 2023-07-16 22:12:50,791 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf/50ddd5ed1f8646d4ac0394409d01a73a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,792 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. completed. 2023-07-16 22:12:50,792 DEBUG [rs(jenkins-hbase4.apache.org,40577,1689545452380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:12:50,792 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:50,792 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:50,792 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,792 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:50,792 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40577,1689545452380' in zk 2023-07-16 22:12:50,794 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,794 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:50,794 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,794 DEBUG [member: 'jenkins-hbase4.apache.org,40577,1689545452380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:50,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40577,1689545452380': 2023-07-16 22:12:50,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40577,1689545452380' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 22:12:50,804 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. completed. 2023-07-16 22:12:50,804 DEBUG [rs(jenkins-hbase4.apache.org,38355,1689545452313)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:12:50,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:50,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:50,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:50,804 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38355,1689545452313' in zk 2023-07-16 22:12:50,807 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:50,807 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,807 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,807 DEBUG [member: 'jenkins-hbase4.apache.org,38355,1689545452313' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38355,1689545452313': 2023-07-16 22:12:50,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38355,1689545452313' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 22:12:50,813 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 22:12:50,813 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:50,813 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:50,813 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,813 INFO [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,815 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,815 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,816 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,817 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,819 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,819 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,819 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,823 DEBUG [(jenkins-hbase4.apache.org,35859,1689545450683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,823 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:12:50,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,825 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 22:12:50,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,865 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689545570610Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689545570825 (+215 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689545570825Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689545570832 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689545570840 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689545570865 (+25 ms) 2023-07-16 22:12:50,868 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 257 msec 2023-07-16 22:12:50,914 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:50,915 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915 2023-07-16 22:12:50,915 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40683, tgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915, rawTgtDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915, srcFsUri=hdfs://localhost:40683, srcDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:12:50,942 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9 2023-07-16 22:12:50,943 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-120725910_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,943 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40683, inputRoot=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9, snapshotDir=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 22:12:50,955 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,990 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:50,991 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:50,991 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:50,991 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:50,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:50,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:50,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,064 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/hadoop-4851210993491135490.jar 2023-07-16 22:12:51,064 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,065 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,065 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,066 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,066 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,067 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:51,068 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:12:51,068 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:12:51,068 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:12:51,069 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:12:51,069 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:12:51,069 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:12:51,070 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:12:51,070 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:12:51,070 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:12:51,071 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:12:51,071 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:51,072 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:51,072 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:51,072 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:51,072 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:51,073 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:51,073 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:51,647 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:12:51,649 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 22:12:51,651 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 22:12:53,309 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:53,309 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:53,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0006_000001 (auth:SIMPLE) 2023-07-16 22:12:53,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0007_000001 (auth:SIMPLE) 2023-07-16 22:12:53,980 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:59,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:01,971 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:06,338 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:07,953 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:13:07,953 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:13:07,969 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:07,970 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:13:07,970 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:13:07,970 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:07,971 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 22:13:07,971 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 22:13:07,971 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858416553_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:07,971 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 22:13:07,972 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/export-test/export-1689545570915/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 22:13:07,977 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:07,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:07,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:07,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 22:13:07,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545587982"}]},"ts":"1689545587982"} 2023-07-16 22:13:07,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 22:13:07,985 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 22:13:07,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, UNASSIGN}] 2023-07-16 22:13:07,988 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, UNASSIGN 2023-07-16 22:13:07,988 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, UNASSIGN 2023-07-16 22:13:07,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=392fa12621b84c8264d40515dcd3f97d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:13:07,989 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545587989"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545587989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545587989"}]},"ts":"1689545587989"} 2023-07-16 22:13:07,989 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b19af7758d48b1f7772c88e2717e164c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:13:07,989 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545587989"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545587989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545587989"}]},"ts":"1689545587989"} 2023-07-16 22:13:07,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 392fa12621b84c8264d40515dcd3f97d, server=jenkins-hbase4.apache.org,40577,1689545452380}] 2023-07-16 22:13:07,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure b19af7758d48b1f7772c88e2717e164c, server=jenkins-hbase4.apache.org,38355,1689545452313}] 2023-07-16 22:13:08,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 22:13:08,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:13:08,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 392fa12621b84c8264d40515dcd3f97d, disabling compactions & flushes 2023-07-16 22:13:08,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:13:08,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:13:08,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. after waiting 0 ms 2023-07-16 22:13:08,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:13:08,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:13:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b19af7758d48b1f7772c88e2717e164c, disabling compactions & flushes 2023-07-16 22:13:08,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:13:08,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:13:08,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. after waiting 0 ms 2023-07-16 22:13:08,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:13:08,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:13:08,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:13:08,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:08,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:08,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d. 2023-07-16 22:13:08,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c. 2023-07-16 22:13:08,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 392fa12621b84c8264d40515dcd3f97d: 2023-07-16 22:13:08,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b19af7758d48b1f7772c88e2717e164c: 2023-07-16 22:13:08,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:13:08,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=392fa12621b84c8264d40515dcd3f97d, regionState=CLOSED 2023-07-16 22:13:08,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545588161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545588161"}]},"ts":"1689545588161"} 2023-07-16 22:13:08,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:13:08,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b19af7758d48b1f7772c88e2717e164c, regionState=CLOSED 2023-07-16 22:13:08,163 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545588163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545588163"}]},"ts":"1689545588163"} 2023-07-16 22:13:08,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-16 22:13:08,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 392fa12621b84c8264d40515dcd3f97d, server=jenkins-hbase4.apache.org,40577,1689545452380 in 173 msec 2023-07-16 22:13:08,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=392fa12621b84c8264d40515dcd3f97d, UNASSIGN in 179 msec 2023-07-16 22:13:08,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-16 22:13:08,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure b19af7758d48b1f7772c88e2717e164c, server=jenkins-hbase4.apache.org,38355,1689545452313 in 174 msec 2023-07-16 22:13:08,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 22:13:08,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b19af7758d48b1f7772c88e2717e164c, UNASSIGN in 180 msec 2023-07-16 22:13:08,169 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545588169"}]},"ts":"1689545588169"} 2023-07-16 22:13:08,170 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 22:13:08,171 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 22:13:08,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-07-16 22:13:08,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 22:13:08,284 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 22:13:08,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,288 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,289 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,290 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44505] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,292 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,292 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,293 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:13:08,293 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,292 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,293 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:13:08,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 22:13:08,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 22:13:08,294 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:08,294 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,294 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:08,294 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:08,294 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-16 22:13:08,294 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:08,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-16 22:13:08,294 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:13:08,294 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:13:08,295 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/recovered.edits] 2023-07-16 22:13:08,295 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf, FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/recovered.edits] 2023-07-16 22:13:08,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 22:13:08,299 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf/e3a42b618b21473f99ace9bfebdb6158 to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/cf/e3a42b618b21473f99ace9bfebdb6158 2023-07-16 22:13:08,299 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf/50ddd5ed1f8646d4ac0394409d01a73a to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/cf/50ddd5ed1f8646d4ac0394409d01a73a 2023-07-16 22:13:08,302 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c/recovered.edits/9.seqid 2023-07-16 22:13:08,302 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/recovered.edits/9.seqid to hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d/recovered.edits/9.seqid 2023-07-16 22:13:08,303 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b19af7758d48b1f7772c88e2717e164c 2023-07-16 22:13:08,303 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/392fa12621b84c8264d40515dcd3f97d 2023-07-16 22:13:08,303 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 22:13:08,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,307 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 22:13:08,309 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 22:13:08,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 22:13:08,310 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545588310"}]},"ts":"9223372036854775807"} 2023-07-16 22:13:08,310 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545588310"}]},"ts":"9223372036854775807"} 2023-07-16 22:13:08,311 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:13:08,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 392fa12621b84c8264d40515dcd3f97d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689545568708.392fa12621b84c8264d40515dcd3f97d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b19af7758d48b1f7772c88e2717e164c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545568708.b19af7758d48b1f7772c88e2717e164c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:13:08,311 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 22:13:08,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545588311"}]},"ts":"9223372036854775807"} 2023-07-16 22:13:08,316 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 22:13:08,319 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-07-16 22:13:08,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 22:13:08,396 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 22:13:08,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 22:13:08,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 22:13:08,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35859] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:08,441 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:40012 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1205832852_1 at /127.0.0.1:39970 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1205832852_1 at /127.0.0.1:36162 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5444 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:33913 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:36188 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70a6a56c-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-858416553_17 at /127.0.0.1:42798 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=667 (was 609) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 183), AvailableMemoryMB=1191 (was 1383) 2023-07-16 22:13:08,441 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-16 22:13:08,441 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 22:13:08,453 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:12,542 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545460132_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:13,741 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:13:22,576 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:36,695 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 22:13:36,696 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:36,808 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 22:13:36,817 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 22:13:36,819 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 22:13:36,829 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:36,933 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 22:13:36,933 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 22:13:36,933 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 22:13:36,933 INFO [Listener at jenkins-hbase4.apache.org/40259] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 22:13:36,933 DEBUG [Listener at jenkins-hbase4.apache.org/40259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b4bf029 to 127.0.0.1:63820 2023-07-16 22:13:36,933 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:36,934 DEBUG [Listener at jenkins-hbase4.apache.org/40259] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 22:13:36,934 DEBUG [Listener at jenkins-hbase4.apache.org/40259] util.JVMClusterUtil(257): Found active master hash=1894733359, stopped=false 2023-07-16 22:13:36,934 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:36,934 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 22:13:36,934 INFO [Listener at jenkins-hbase4.apache.org/40259] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:13:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:36,935 INFO [Listener at jenkins-hbase4.apache.org/40259] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 22:13:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:36,936 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:13:36,935 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:36,936 DEBUG [Listener at jenkins-hbase4.apache.org/40259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16313f4f to 127.0.0.1:63820 2023-07-16 22:13:36,936 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:36,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:36,936 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44505,1689545452226' ***** 2023-07-16 22:13:36,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:36,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:36,936 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:36,936 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 22:13:36,937 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38355,1689545452313' ***** 2023-07-16 22:13:36,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:36,937 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:36,937 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 22:13:36,937 INFO [RS:0;jenkins-hbase4:44505] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 22:13:36,937 INFO [RS:1;jenkins-hbase4:38355] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 22:13:36,937 INFO [RS:0;jenkins-hbase4:44505] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 22:13:36,937 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40577,1689545452380' ***** 2023-07-16 22:13:36,937 INFO [RS:0;jenkins-hbase4:44505] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 22:13:36,937 INFO [RS:1;jenkins-hbase4:38355] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 22:13:36,937 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:36,937 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 22:13:36,937 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 22:13:36,937 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(3305): Received CLOSE for f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:13:36,937 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 22:13:36,937 INFO [RS:1;jenkins-hbase4:38355] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 22:13:36,938 INFO [RS:2;jenkins-hbase4:40577] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 22:13:36,938 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:13:36,938 INFO [RS:2;jenkins-hbase4:40577] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 22:13:36,938 DEBUG [RS:1;jenkins-hbase4:38355] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ed4a1a8 to 127.0.0.1:63820 2023-07-16 22:13:36,938 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 22:13:36,938 DEBUG [RS:1;jenkins-hbase4:38355] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:36,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2ccdabdc33f0a32536c3c50eec21768, disabling compactions & flushes 2023-07-16 22:13:36,941 INFO [RS:1;jenkins-hbase4:38355] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 22:13:36,938 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:13:36,941 INFO [RS:1;jenkins-hbase4:38355] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 22:13:36,941 DEBUG [RS:0;jenkins-hbase4:44505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x652e1d2e to 127.0.0.1:63820 2023-07-16 22:13:36,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:13:36,938 INFO [RS:2;jenkins-hbase4:40577] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 22:13:36,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:13:36,941 DEBUG [RS:0;jenkins-hbase4:44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:36,941 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(3305): Received CLOSE for a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:13:36,942 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 22:13:36,942 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:13:36,941 INFO [RS:1;jenkins-hbase4:38355] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 22:13:36,942 DEBUG [RS:2;jenkins-hbase4:40577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c8d9ebd to 127.0.0.1:63820 2023-07-16 22:13:36,942 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 22:13:36,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a4c2e323cf1aa04155615b8252d3f5d8, disabling compactions & flushes 2023-07-16 22:13:36,942 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1478): Online Regions={f2ccdabdc33f0a32536c3c50eec21768=hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768.} 2023-07-16 22:13:36,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:13:36,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. after waiting 0 ms 2023-07-16 22:13:36,943 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 22:13:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:13:36,943 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-16 22:13:36,942 DEBUG [RS:2;jenkins-hbase4:40577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:36,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 22:13:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. after waiting 0 ms 2023-07-16 22:13:36,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:13:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:13:36,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a4c2e323cf1aa04155615b8252d3f5d8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 22:13:36,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 22:13:36,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f2ccdabdc33f0a32536c3c50eec21768 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 22:13:36,944 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 22:13:36,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 22:13:36,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 22:13:36,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 22:13:36,944 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1478): Online Regions={a4c2e323cf1aa04155615b8252d3f5d8=hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8.} 2023-07-16 22:13:36,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 22:13:36,944 DEBUG [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1504): Waiting on a4c2e323cf1aa04155615b8252d3f5d8 2023-07-16 22:13:36,944 DEBUG [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1504): Waiting on f2ccdabdc33f0a32536c3c50eec21768 2023-07-16 22:13:36,944 DEBUG [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 22:13:36,945 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:36,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/.tmp/l/a5a30ebe1d4a495b857b6230f736489f 2023-07-16 22:13:36,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/.tmp/info/dc7a6373979048aba988fb6b0c49d3cd 2023-07-16 22:13:36,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/.tmp/info/9b768868526841b0b68168a035b6097f 2023-07-16 22:13:36,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5a30ebe1d4a495b857b6230f736489f 2023-07-16 22:13:36,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/.tmp/l/a5a30ebe1d4a495b857b6230f736489f as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/l/a5a30ebe1d4a495b857b6230f736489f 2023-07-16 22:13:36,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc7a6373979048aba988fb6b0c49d3cd 2023-07-16 22:13:37,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/.tmp/info/9b768868526841b0b68168a035b6097f as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/info/9b768868526841b0b68168a035b6097f 2023-07-16 22:13:37,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5a30ebe1d4a495b857b6230f736489f 2023-07-16 22:13:37,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/l/a5a30ebe1d4a495b857b6230f736489f, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 22:13:37,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f2ccdabdc33f0a32536c3c50eec21768 in 58ms, sequenceid=18, compaction requested=false 2023-07-16 22:13:37,006 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:37,006 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:37,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/info/9b768868526841b0b68168a035b6097f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 22:13:37,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a4c2e323cf1aa04155615b8252d3f5d8 in 68ms, sequenceid=6, compaction requested=false 2023-07-16 22:13:37,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/.tmp/rep_barrier/2fa640332fac4c01b1dea2441adee5a7 2023-07-16 22:13:37,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/namespace/a4c2e323cf1aa04155615b8252d3f5d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:13:37,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/acl/f2ccdabdc33f0a32536c3c50eec21768/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 22:13:37,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:37,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:13:37,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a4c2e323cf1aa04155615b8252d3f5d8: 2023-07-16 22:13:37,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689545455291.a4c2e323cf1aa04155615b8252d3f5d8. 2023-07-16 22:13:37,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:37,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:13:37,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2ccdabdc33f0a32536c3c50eec21768: 2023-07-16 22:13:37,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689545456069.f2ccdabdc33f0a32536c3c50eec21768. 2023-07-16 22:13:37,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fa640332fac4c01b1dea2441adee5a7 2023-07-16 22:13:37,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/.tmp/table/c7ca13bf8bbc4c1b8bbdded53785ad94 2023-07-16 22:13:37,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7ca13bf8bbc4c1b8bbdded53785ad94 2023-07-16 22:13:37,062 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/.tmp/info/dc7a6373979048aba988fb6b0c49d3cd as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/info/dc7a6373979048aba988fb6b0c49d3cd 2023-07-16 22:13:37,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc7a6373979048aba988fb6b0c49d3cd 2023-07-16 22:13:37,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/info/dc7a6373979048aba988fb6b0c49d3cd, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 22:13:37,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/.tmp/rep_barrier/2fa640332fac4c01b1dea2441adee5a7 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/rep_barrier/2fa640332fac4c01b1dea2441adee5a7 2023-07-16 22:13:37,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fa640332fac4c01b1dea2441adee5a7 2023-07-16 22:13:37,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/rep_barrier/2fa640332fac4c01b1dea2441adee5a7, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 22:13:37,073 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/.tmp/table/c7ca13bf8bbc4c1b8bbdded53785ad94 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/table/c7ca13bf8bbc4c1b8bbdded53785ad94 2023-07-16 22:13:37,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7ca13bf8bbc4c1b8bbdded53785ad94 2023-07-16 22:13:37,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/table/c7ca13bf8bbc4c1b8bbdded53785ad94, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 22:13:37,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 134ms, sequenceid=131, compaction requested=false 2023-07-16 22:13:37,088 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 22:13:37,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:37,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 22:13:37,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 22:13:37,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 22:13:37,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 22:13:37,144 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40577,1689545452380; all regions closed. 2023-07-16 22:13:37,145 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44505,1689545452226; all regions closed. 2023-07-16 22:13:37,145 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38355,1689545452313; all regions closed. 2023-07-16 22:13:37,157 DEBUG [RS:0;jenkins-hbase4:44505] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs 2023-07-16 22:13:37,157 DEBUG [RS:2;jenkins-hbase4:40577] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs 2023-07-16 22:13:37,157 INFO [RS:0;jenkins-hbase4:44505] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44505%2C1689545452226:(num 1689545454633) 2023-07-16 22:13:37,157 INFO [RS:2;jenkins-hbase4:40577] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40577%2C1689545452380:(num 1689545454635) 2023-07-16 22:13:37,157 DEBUG [RS:2;jenkins-hbase4:40577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:37,157 DEBUG [RS:0;jenkins-hbase4:44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:37,157 INFO [RS:2;jenkins-hbase4:40577] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:37,157 INFO [RS:0;jenkins-hbase4:44505] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:37,158 DEBUG [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs 2023-07-16 22:13:37,158 INFO [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38355%2C1689545452313.meta:.meta(num 1689545454949) 2023-07-16 22:13:37,158 INFO [RS:0;jenkins-hbase4:44505] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 22:13:37,158 INFO [RS:2;jenkins-hbase4:40577] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 22:13:37,158 INFO [RS:2;jenkins-hbase4:40577] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 22:13:37,158 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:37,158 INFO [RS:2;jenkins-hbase4:40577] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 22:13:37,159 INFO [RS:2;jenkins-hbase4:40577] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 22:13:37,158 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:37,158 INFO [RS:0;jenkins-hbase4:44505] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 22:13:37,159 INFO [RS:0;jenkins-hbase4:44505] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 22:13:37,159 INFO [RS:0;jenkins-hbase4:44505] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 22:13:37,160 INFO [RS:2;jenkins-hbase4:40577] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40577 2023-07-16 22:13:37,160 INFO [RS:0;jenkins-hbase4:44505] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44505 2023-07-16 22:13:37,165 DEBUG [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/oldWALs 2023-07-16 22:13:37,165 INFO [RS:1;jenkins-hbase4:38355] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38355%2C1689545452313:(num 1689545454623) 2023-07-16 22:13:37,165 DEBUG [RS:1;jenkins-hbase4:38355] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:37,165 INFO [RS:1;jenkins-hbase4:38355] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:37,165 INFO [RS:1;jenkins-hbase4:38355] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 22:13:37,166 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:37,166 INFO [RS:1;jenkins-hbase4:38355] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38355 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44505,1689545452226 2023-07-16 22:13:37,170 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:37,171 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:13:37,171 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:13:37,171 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38355,1689545452313 2023-07-16 22:13:37,171 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:13:37,171 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40577,1689545452380] 2023-07-16 22:13:37,171 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:13:37,171 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40577,1689545452380 2023-07-16 22:13:37,172 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40577,1689545452380; numProcessing=1 2023-07-16 22:13:37,174 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40577,1689545452380 already deleted, retry=false 2023-07-16 22:13:37,174 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40577,1689545452380 expired; onlineServers=2 2023-07-16 22:13:37,174 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44505,1689545452226] 2023-07-16 22:13:37,174 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44505,1689545452226; numProcessing=2 2023-07-16 22:13:37,176 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44505,1689545452226 already deleted, retry=false 2023-07-16 22:13:37,176 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44505,1689545452226 expired; onlineServers=1 2023-07-16 22:13:37,176 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38355,1689545452313] 2023-07-16 22:13:37,176 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38355,1689545452313; numProcessing=3 2023-07-16 22:13:37,177 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38355,1689545452313 already deleted, retry=false 2023-07-16 22:13:37,177 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38355,1689545452313 expired; onlineServers=0 2023-07-16 22:13:37,177 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35859,1689545450683' ***** 2023-07-16 22:13:37,177 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 22:13:37,177 DEBUG [M:0;jenkins-hbase4:35859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31d25c14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:13:37,177 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35859,1689545450683 2023-07-16 22:13:37,177 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35859,1689545450683; all regions closed. 2023-07-16 22:13:37,177 DEBUG [M:0;jenkins-hbase4:35859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:37,177 DEBUG [M:0;jenkins-hbase4:35859] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 22:13:37,177 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 22:13:37,177 DEBUG [M:0;jenkins-hbase4:35859] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 22:13:37,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689545454140] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689545454140,5,FailOnTimeoutGroup] 2023-07-16 22:13:37,178 INFO [M:0;jenkins-hbase4:35859] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 22:13:37,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689545454141] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689545454141,5,FailOnTimeoutGroup] 2023-07-16 22:13:37,178 INFO [M:0;jenkins-hbase4:35859] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 22:13:37,178 INFO [M:0;jenkins-hbase4:35859] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 22:13:37,178 DEBUG [M:0;jenkins-hbase4:35859] master.HMaster(1512): Stopping service threads 2023-07-16 22:13:37,178 INFO [M:0;jenkins-hbase4:35859] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 22:13:37,178 ERROR [M:0;jenkins-hbase4:35859] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 22:13:37,178 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 22:13:37,178 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:13:37,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:13:37,179 INFO [M:0;jenkins-hbase4:35859] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 22:13:37,179 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 22:13:37,179 DEBUG [M:0;jenkins-hbase4:35859] zookeeper.ZKUtil(398): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 22:13:37,179 WARN [M:0;jenkins-hbase4:35859] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 22:13:37,179 INFO [M:0;jenkins-hbase4:35859] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 22:13:37,179 INFO [M:0;jenkins-hbase4:35859] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 22:13:37,180 DEBUG [M:0;jenkins-hbase4:35859] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 22:13:37,180 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:37,180 DEBUG [M:0;jenkins-hbase4:35859] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:37,180 DEBUG [M:0;jenkins-hbase4:35859] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 22:13:37,180 DEBUG [M:0;jenkins-hbase4:35859] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:37,180 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.40 KB heapSize=449.66 KB 2023-07-16 22:13:37,195 INFO [M:0;jenkins-hbase4:35859] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.40 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f09fa3b2a82649ce933bb4d288982521 2023-07-16 22:13:37,199 INFO [M:0;jenkins-hbase4:35859] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f09fa3b2a82649ce933bb4d288982521 2023-07-16 22:13:37,200 DEBUG [M:0;jenkins-hbase4:35859] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f09fa3b2a82649ce933bb4d288982521 as hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f09fa3b2a82649ce933bb4d288982521 2023-07-16 22:13:37,205 INFO [M:0;jenkins-hbase4:35859] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f09fa3b2a82649ce933bb4d288982521 2023-07-16 22:13:37,205 INFO [M:0;jenkins-hbase4:35859] regionserver.HStore(1080): Added hdfs://localhost:40683/user/jenkins/test-data/a949f770-358a-97bd-163e-49dcf983b5e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f09fa3b2a82649ce933bb4d288982521, entries=119, sequenceid=899, filesize=28.5 K 2023-07-16 22:13:37,206 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegion(2948): Finished flush of dataSize ~373.40 KB/382357, heapSize ~449.64 KB/460432, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=899, compaction requested=false 2023-07-16 22:13:37,207 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:37,207 DEBUG [M:0;jenkins-hbase4:35859] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 22:13:37,211 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:37,211 INFO [M:0;jenkins-hbase4:35859] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 22:13:37,212 INFO [M:0;jenkins-hbase4:35859] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35859 2023-07-16 22:13:37,214 DEBUG [M:0;jenkins-hbase4:35859] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35859,1689545450683 already deleted, retry=false 2023-07-16 22:13:37,272 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,272 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x101703024210001, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,272 INFO [RS:0;jenkins-hbase4:44505] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44505,1689545452226; zookeeper connection closed. 2023-07-16 22:13:37,273 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f1dabaa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f1dabaa 2023-07-16 22:13:37,373 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,373 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): master:35859-0x101703024210000, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,373 INFO [M:0;jenkins-hbase4:35859] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35859,1689545450683; zookeeper connection closed. 2023-07-16 22:13:37,473 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,473 INFO [RS:1;jenkins-hbase4:38355] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38355,1689545452313; zookeeper connection closed. 2023-07-16 22:13:37,473 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:38355-0x101703024210002, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,473 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@47d9fa5c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@47d9fa5c 2023-07-16 22:13:37,573 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,573 INFO [RS:2;jenkins-hbase4:40577] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40577,1689545452380; zookeeper connection closed. 2023-07-16 22:13:37,573 DEBUG [Listener at localhost/42683-EventThread] zookeeper.ZKWatcher(600): regionserver:40577-0x101703024210003, quorum=127.0.0.1:63820, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:37,573 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ff6bf89] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ff6bf89 2023-07-16 22:13:37,574 INFO [Listener at jenkins-hbase4.apache.org/40259] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 22:13:37,574 WARN [Listener at jenkins-hbase4.apache.org/40259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 22:13:37,579 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:37,684 WARN [BP-2023172456-172.31.14.131-1689545446625 heartbeating to localhost/127.0.0.1:40683] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 22:13:37,684 WARN [BP-2023172456-172.31.14.131-1689545446625 heartbeating to localhost/127.0.0.1:40683] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2023172456-172.31.14.131-1689545446625 (Datanode Uuid e76470e9-6f8a-46c2-bcd1-f9cc454bc7b4) service to localhost/127.0.0.1:40683 2023-07-16 22:13:37,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data5/current/BP-2023172456-172.31.14.131-1689545446625] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:37,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data6/current/BP-2023172456-172.31.14.131-1689545446625] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:37,687 WARN [Listener at jenkins-hbase4.apache.org/40259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 22:13:37,690 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:37,793 WARN [BP-2023172456-172.31.14.131-1689545446625 heartbeating to localhost/127.0.0.1:40683] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 22:13:37,793 WARN [BP-2023172456-172.31.14.131-1689545446625 heartbeating to localhost/127.0.0.1:40683] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2023172456-172.31.14.131-1689545446625 (Datanode Uuid 8a90241b-7005-468c-b8d3-317cf41b3c95) service to localhost/127.0.0.1:40683 2023-07-16 22:13:37,794 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data3/current/BP-2023172456-172.31.14.131-1689545446625] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:37,794 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data4/current/BP-2023172456-172.31.14.131-1689545446625] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:37,796 WARN [Listener at jenkins-hbase4.apache.org/40259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 22:13:37,801 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:37,915 WARN [BP-2023172456-172.31.14.131-1689545446625 heartbeating to localhost/127.0.0.1:40683] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 22:13:37,916 WARN [BP-2023172456-172.31.14.131-1689545446625 heartbeating to localhost/127.0.0.1:40683] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2023172456-172.31.14.131-1689545446625 (Datanode Uuid ae818872-331e-4e73-be16-dc64f4fd747e) service to localhost/127.0.0.1:40683 2023-07-16 22:13:37,916 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data1/current/BP-2023172456-172.31.14.131-1689545446625] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:37,917 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1142833e-9cd9-bca5-1910-834ee9ea24da/cluster_2a67c7ca-d23f-8a29-21e1-b0225674c1ba/dfs/data/data2/current/BP-2023172456-172.31.14.131-1689545446625] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:37,955 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:38,081 INFO [Listener at jenkins-hbase4.apache.org/40259] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 22:13:38,171 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(1293): Minicluster is down